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Abstract 

In the setting of a Gaussian channel without power constraints, proposed by Poltyrev, the 
codewords are points in an n-dimensional Euclidean space (an infinite constellation) and the 
tradeoff between their density and the error probability is considered. The capacity in this setting 
is the highest achievable normalized log density (NLD) with vanishing error probability. This 
capacity as well as error exponent bounds for this setting are known. In this work we consider 
the optimal performance achievable in the fixed blocklength (dimension) regime. We provide two 
new achievability bounds, and extend the validity of the sphere bound to finite dimensional infinite 
constellations. We also provide asymptotic analysis of the bounds: When the NLD is fixed, we 
provide asymptotic expansions for the bounds that are significantly tighter than the previously 
known error exponent results. When the error probability is fixed, we show that as n grows, the 
gap to capacity is inversely proportional (up to the first order) to the square-root of n where 
the proportion constant is given by the inverse Q-function of the allowed error probability, times 
the square root of i. In an analogy to similar result in channel coding, the dispersion of infinite 
constellations is ^nat 2 per channel use. All our achievability results use lattices and therefore 
hold for the maximal error probability as well. Connections to the error exponent of the power 
constrained Gaussian channel and to the volume-to-noise ratio as a figure of merit are discussed. 
In addition, we demonstrate the tightness of the results numerically and compare to state-of-the-art 
coding schemes. 

Index Terms 

Infinite constellations, Gaussian channel, Poltyrev setting, Poltyrev exponent, finite block- 
length, dispersion, precise asymptotics 



I. Introduction 

Coding schemes over the Gaussian channel are traditionally limited by the average/peak 
power of the transmitted signal [1J. Without the power restriction (or a similar restriction) 
the channel capacity becomes infinite, since one can space the codewords arbitrarily far 
apart from each other and achieve a vanishing error probability. However, many coded 
modulation schemes take an infinite constellation (IC) and restrict the usage to points of 
the IC that lie within some n-dimensional form in Euclidean space (a 'shaping' region). 
Probably the most important example for an IC is a lattice (see Fig. [D, and examples for 
the shaping regions include a hypersphere in n dimensions, and a Voronoi region of another 
lattice B2l. 

The material in this paper will be presented in part at the IEEE International Symposium on Information Theory (ISIT) 
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(a) A lattice (b) A non-lattice infinite constellation 

Fig. 1. Examples for 2-dimensional infinite constellations. Only a finite section of the IC is shown. 



In 1994, Poltyrev [0 studied the model of a channel with Gaussian noise without power 
constraints. In this setting the codewords are simply points of the infinite constellation in 
the n-dimensional Euclidean space. The analog to the number of codewords is the density 
7 of the constellation points (the average number of points per unit volume). The analog 
of the communication rate is the normalized log density (NLD) d = ^log7. The error 
probability in this setting can be thought of as the average error probability, where all the 
points of the IC have equal transmission probability (precise definitions follow later on in 
the paper). 

Poltyrev showed that the NLD S is the analog of the rate in classical channel coding, and 
established the corresponding "capacity", the ultimate limit for the NLD denoted S* (also 
known as Poltyrev 's capacity), given by ~ log 2 * 2 , where a 2 denotes the noise variance per 
dimension!! Random coding, expurgation and sphere packing error exponent bounds were 
derived, which are analogous to Gallager's error exponents in the classical channel coding 
setting dUl, and to the error exponents of the power-constrained additive white Gaussian 
noise (AWGN) channel 0, H. 

In classical channel coding, the channel capacity gives the ultimate limit for the rate 
when arbitrarily small error probability is required, and the error exponent quantifies the 
(exponential) speed at which the error probability goes to zero as the dimension grows, 
where the rate is fixed (and below the channel capacity). This type of analysis is asymptotic 
in nature - neither the capacity nor the error exponent theory can tell what is the best 
achievable error probability with a given rate R and block length n. A big step in the non- 
asymptotic direction was recently made in a paper by Polyanskiy et al. J6l, where explicit 
bounds for finite n were derived. In addition to the error exponent formulation, another 
asymptotic question can be asked: Suppose that the (codeword) error probability is fixed 



'logarithms are taken w.r.t. to the natural base e and rates are given in nats. 
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to some value e. Let R £ {n) denote the maximal rate for which there exist communication 
schemes with codelength n and error probability at most e. As n grows, R E (n) approaches 
the channel capacity C, and the speed of convergence is quantified by [|7)[|6) 

Re(n) = C- \[^Q-\e) + O (^) , (1) 
V n \ n J 

where is the inverse complementary standard Gaussian cumulative distribution func- 

tion. The constant V, termed the channel dispersion, is the variance of the information 
spectrum i(x;y) = log ^t^ttL f° r a capacity-achieving distribution. This result holds 
for discrete memoryless channels (DMC's), and was recently extended to the (power con- 
strained) AWGN channel [8JL6J. More refinements of © and further details can be found 
in GO- 

In this paper we take an in-depth look at the unconstrained Gaussian channel where 
the block length (dimension) is finite. We give new achievability bounds which enable 
easy evaluation of the achievable error probability. We then analyze the new achievability 
bounds and the so-called sphere bound (converse bound), and obtain asymptotic analysis 
of the lowest achievable error probability for fixed NLD S which greatly refines Poltyrev's 
error exponent results. In addition, we analyze the behavior of the highest NLD when the 
error probability is fixed. We show that the behavior demonstrated in (OQ) for DMC's and the 
power constrained AWGN channel carries on to the unconstrained AWGN channel as well. 
We demonstrate the tightness of the results both analytically and numerically, and compare 
to state-of-the-art coding schemes. 

The main results in the paper are summarized below. 

A. New Finite-Dimensional Performance Bounds 

Poltyrev's achievability results |]3j for the capacity and for the error exponent are based 
on a bound that holds for finite dimensions, but is hard to calculate, as it involves optimizing 
w.r.t. a parameter and 3-dimensional integration. We derive two new bounds that hold for 
finite dimensions, and are easier to calculate than Poltyrev's. Like Poltyrev's bound, we 
bound the error probability by the sum of the probability that the noise leaves a certain 
region (a sphere), and the probability of error for noise realization within that sphere. 
This classic technique is due to Gallager sometimes called "Gallager's first bounding 
technique" IfTOl . Our first bound, called the typicality bound, is based on a simple 'typicality' 
decoder (close in spirit to that used in the standard achievability proofs [[TTIO . It shows that 
there exist IC's with NLD 5 and error probability bounded by 

P e < Pl B (n, 6) 4 e nS V n r n + Pr {||Z|| > r} , (2) 

where V n denotes the volume of an n-dimensional sphere with unit radius lfl2l and Z denotes 
the noise vector. The bound holds for any r > 0, and the value minimizing the bound is 
given by r = cryn(l + 26* — 26). Evaluating this bound only involves ID integration, and 
the simple expression is amenable to precise asymptotic analysis. A stronger bound, called 
the maximum likelihood (ML) bound, which is based on the ML decoder, shows that there 
exist IC's with error probability bounded by 

Pe < P e MLB (n, 5) 4 e nS V n f f R (r)r n dr + Pr {||Z|| > r} , (3) 

J o 
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Jr(-) is the pdf of the norm ||Z|| of the noise vector. The bound holds for any r > 0, and 
the value minimizing the bound is given by r = r e g = e~ s V n . Note that r e g, called 
the effective radius of the lattice (or IC), is the radius of a sphere with the same volume 
as the Voronoi cell of the lattice (or the average volume of the Voronoi cells of the icjl ). 
Evaluating the ML bound also involves ID integration only. We further show that the ML 
bound gives the exact value of Poltyrev's bound, therefore the simplicity does not come at 
the price of a weaker bound. 

In the achievability part of the results we use lattices (and the Minkowski-Hlawka theorem 
lfT3llfT4l ). Because of the regular structure of lattices, all our achievability results hold in 
the stronger sense of maximal error probability. In the converse part we base our results on 
the sphere bound lfT5l ll3l l[T6l , i.e. on the fact that the error probability is lower bounded by 
the probability that the noise leaves a sphere with the same volume as a Voronoi cell. For 
lattices (and more generally, for IC's with equal-volume Voronoi cells), it is given by 

P e >P e SB (n,d)±Pr{\\Z\\>r cS }. (4) 

We extend the validity of the sphere bound to any IC, and to the stronger sense of average 
error probability. Therefore our results hold for both average and maximal error probability, 
and for any IC (lattice or not). 

Note that since the optimal value for r in the ML bound © is exactly r cff , the difference 
between the ML upper bound and the sphere packing lower bound is the left term in ©. 
This fact enables a precise evaluation of the best achievable P e , see Section |V] 

B. Asymptotic Analysis: Fixed NLD 

The asymptotics of the bounds on the error probability were studied by Poltyrev (31 using 
large deviation techniques and error exponents. The error exponent for the unconstrained 
AWGN is defined in the usual manner: 

E(<5) 4 lim - log P e (n, S), (5) 

n— >oo n 

(assuming the limit exists), where P e (n, S) is the best error probability for any IC with NLD 
S. Poltyrev showed that the error exponent is bounded by the random coding and sphere 
packing exponents E r (<5) and E sp (<5) which are the infinite constellation counterparts of 
the similar exponents in the power constrained AWGN. The random coding and sphere 
packing exponents coincide when the NLD is above the critical NLD S cr , defined later 
on. However, even when the error exponent bounds coincide, the optimal error probability 
P e (n, S) is known only up to an unknown sub-exponential term (which can be, for example 
n 100 , or worse, e.g. e^). We present a significantly tighter asymptotic analysis using a 
more delicate (and direct) approach. Specifically, we show that the sphere bound is given 
asymptotically by 

P e SB (n,S) <* e-^W ^ff^ , (6) 

2 Note that the average volume of the Voronoi cells is not always well-defined, as in general there may exist cells with 
infinite volume. See HV-Dl for more details. 
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where a = b means that | — > 1. We further show that the ML bound is given by 

e-*^, 8 < S cr ; 



> l ^(M) = <i e " nErW 7fc' . 5 = 6 ~> (7) 



,_l e 2(«*-*) 
C ( 2 - e 2(«*-«))( e 2(«*-«)_i)' cr 



As a consequence, for NLD above 8 cr , P e (n, 8) is known asymptotically up to a constant, 
compared to a sub-exponential term in Poltyrev's error exponent analysis. The weaker 
typicality bound is given by 

P? B (n, S) - e-^^-L ■ 1 + Jf ~ S) (8) 
y/nn 2(8 — 0) 

where E t (<5) is the typicality exponent, defined later on, which is lower than E r (<5). 



C. Asymptotic Analysis: Fixed Error Probability 

For a fixed error probability value e, let 8 £ (n) denote the maximal NLD for which there 
exists an IC with dimension n and error probability at most e. We shall be interested in 
the asymptotic behavior 8 £ (n). This type of analysis for infinite constellations has never 
appeared in literature (to the best of the authors' knowledge). In the current paper we utilize 
central limit theorem (CLT) type tools (specifically, the Berry-Esseen theorem) to give a 
precise asymptotic analysis of 8 £ (n), a result analogous to the channel dispersion [|7][|8][]6] 
in channel coding. Specifically, we show that 

'.(») = «• + ^ lo gn + g). (9) 

By the similarity to Eq. (QQ), we identify the constant | as the dispersion of infinite constel- 
lations. This fact can be intuitively explained in several ways: 

• The dispersion as the (inverse of the) second derivative of the error exponent: for 
DMC's and for the power constrained AWGN channel, the channel dispersion is given 
by the inverse of the second derivative of the error exponent evaluated at the capacity 
J6j. Straightforward differentiation of the error exponent E(<5) (which near the capacity 
is given by E r (<5) = E sp (<5)) verifies the value of ~. 

• The unconstrained AWGN channel as the high-SNR AWGN channel: While the capacity 
of the power constrained AWGN channel grows without bound with the SNR, the error 
exponent attains a nontrivial limit. This limit is the error exponent of the unconstrained 
AWGN channel (as noticed in J21), where the distance to capacity is replaced by the 
NLD distance to 8*. By this analogy, we examine the high-SNR limit of the dispersion 
of the AWGN channel (given in flUH by |(1 - (1 + SNR) -2 )) and arrive at the 
expected value of \. 



D. Volume -to -Noise Ratio (VNR) 

Another figure of merit for lattices (that can be defined for general IC's as well) is the 
volume-to-noise ratio (VNR), which generalizes the SNR notion lfT6l (see also ifTTl ). The 
VNR quantifies how good a lattice is for channel coding over the unconstrained AWGN 
at some given error probability e. It is known that for any e > 0, the optimal (minimal) 
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VNR of any lattice approaches 1 when the dimension n grows (see e.g. [fTTl ). We note that 
the VNR and the NLD are tightly connected, and deduce equivalent finite-dimensional and 
asymptotic results for the optimal VNR. 

The paper is organized as follows. In Section [XT] we define the notations and in Section [DTI 
we review previous results. In Section [IV] we derive the new typicality and ML bounds for 
the optimal error probability of finite dimensional IC's, and we refine the sphere bound as 
a lower bound on the average error probability for any finite dimensional IC. In Section [V] 
the bounds are analyzed asymptotically with the dimension where the NLD is fixed, to 
derive asymptotic bounds that refine the error exponent bounds. In Section [VI] we fix the 
error probability and study the asymptotic behavior of the optimal achievable NLD with 
n. We use normal approximation tools to derive the dispersion theorem for the setting. In 
Section IVIII we compare the bounds from previous sections with the performance of some 
good known infinite constellations. In Section [Villi we discuss the VNR and its connection 
to the NLD <5. We conclude the paper in Section [DO 

II. Definitions 

A. Notation 

We adopt most of the notations of Poltyrev's paper [3J: Let Cb(a) denote a hypercube 
in R n 

Cb(a) = jx G R n s.t. V 4 |a; 4 | < ^} . (10) 

Let Ball(r) denote a hypersphere in R n and radius r > 0, centered at the origin 

Ball(r) = {x G E" s.t. ||x|| < r}, (11) 

and let Ball(y, r) denote a hypersphere in R n and radius r > 0, centered at y G R" 

Ball(y, r) = {x G R n s.t. ||x - y|| < r}. (12) 

Let S be an IC. We denote by M(S, a) the number of points in the intersection of Cb(a) 
and the IC S, i.e. M(S, a) = \Sf] Cb(a) |. The density of S, denoted by 7(5), or simply 
7, measured in points per volume unit, is defined by 

A M(S,a) 
7(5) = km sup — . (13) 

a— >oo Q> 

The normalized log density (NLD) S is defined by 

S = S(S) = -log 7. (14) 

n 

It will prove useful to define the following: 

Definition 1 (Expectation over points in a hypercube): Let E a [/(s)] denote the expecta- 
tion of an arbitrary function f(s), f : «S — > R, where s is drawn uniformly from the code 
points that reside in the hypercube Cb(a): 

E m <15) 

v ' ' seSnCb(a) 
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Throughout the paper, an IC will be used for transmission of information through the 
unconstrained AWGN channel with noise variance o 2 (per dimension). The additive noise 
shall be denoted by Z = [Zi, Z n ] T . An instantiation of the noise vector shall be denoted 

by z = fa, ...,z n } T . 

For s E S, let P e (s) denote the error probability when s was transmitted. When the 
maximum likelihood (ML) decoder is used, the error probability is given by 

P e (s) = Pr{s + Z£W(s)}, (16) 

where W(s) is the Voronoi region of s, i.e. the convex polytope of the points that are closer 
to s than to any other point s' £ S. The maximal error probability is defined by 

P*°x(S) A sap P e (s), (17) 

and the average error probability is defined by 

P e {S) 4limsupE a [P e (s)]. (18) 

a— >oo 

The following related quantities, define the optimal performance limits for IC's. 
Definition 2 (Optimal Error Probability and Optimal NLD): 

• Given NLD value S and dimension n, P e (n,S) denotes the optimal error probability 
that can be obtained by any IC with NLD d and a finite dimension n. 

• Given an error probability value e and dimension n, S s (n) denotes the maximal NLD 
for which there exists an IC with dimension n and error probability at most e. 

Clearly, these two quantities are tightly connected, and any nonasymptotic bound for either 
quantity gives a bound for the other. However, their asymptotic analysis (with n — >■ oo) is 
different: for fixed 5 < 6*, it is known that P e (n, 6) vanishes exponentially with n. In this 
paper we will refine these results. For a fixed error probability e, it is known that S £ (n) goes 
to S* when n — > oo. In this paper we will show that the gap to 5* vanishes like O (1/y/n), 
see Section [V]] 

fn = 0(g n ) shall mean that there exist a constant c s.t. for all n > n for some n , 
\fn\ < c ■ g n . Similarly, /„ < 0(g n ) shall mean that there exist c, n s.t. for all n > n , 
fn < c-g n . f n > 0(g n ) means -/„ < 0(-g n ). f n = <d(g n ) shall mean that both /„ = 0(g n ) 
and g n = 0(f n ) hold. 



B. Measuring the Gap from Capacity 

Suppose we are given an IC S with a given density 7 (and NLD S = - log 7), used for 
information transmission over the unconstrained AWGN with noise variance a 2 . The gap 
from optimality can be quantified in several ways. 

Knowing that the optimal NLD (for n — > 00) is 6*, we may consider the difference 

AS = 8* - S, (19) 

which gives the gap to capacity in nats, where a zero gap means that we are working at 
capacity. An equivalent alternative would be to measure the ratio between the noise variance 
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that is tolerable (in the capacity sense) with the given NLD S, given by t^t> an d the actual 
noise variance a 2 (equal to e ™ ). This ratio is given by 



(7 

For lattices, the term e~ 2S is equal to v 2 l r \ where v is the volume of a Voronoi cell of 
the lattice. Therefore fi was termed the Volume-to-Noise Ratio (VNR) by Forney et al. [fT6l 
(where it is denoted by a 2 (A, a 2 )). The VNR can be defined for general IC's as well. It is 
generally above 1 (below capacity) and approaches 1 at capacity. It is often expressed in 
dB 0, i.e. 

-25 /(Ottp) 

10 log 10 - '- = 10 log 10 e 2{s *- s) S 8.6859A5. (21) 

Note that the VNR appears under different names and scalings in the literature. Poltyrev 
|[3l defined the quantity and called it the Generalized SNR (and also denoted it by ji). 
In certain cases the latter definition is beneficial, as it can be viewed as the dual of the 
normalized second moment (NSM), which at n — > oo approaches ^ ifTTl . 

An alternative way to quantify the gap from optimal performance is based on the fact 
that the Voronoi regions of an optimal IC (at n — >■ oo) becomes sphere-like. For example, 
the sphere bound (the converse bound) is based on a sphere with the same volume as the 
Voronoi cells of the IC (i.e. a sphere with radius r c s). As n grows, the Voronoi regions of 
the optimal IC (that achieves capacity) becomes closer to a sphere with squared radius that 
is equal to the mean squared radius of the noise, na 2 . Therefore a plausible way to measure 
the gap from optimality would be to measure the ratio between the squared effective radius 
of the IC and the expected squared noise amplitude, i.e. 

P^ = 6 ~ 2 ■ (22) 
na z na 1 

This quantity was called "Lattice SNR" in [fT51 . and "Voronoi-to-Noise Effective Radius 
Ratio" (squared) in [fT8l . Similarly to the VNR \l, this ratio also approaches 1 at capacity, and 
is also often expressed in dB. However, the two measures (12"0l and (|22l) are not equivalent. 
For a given gap in dB, different IC densities (and NLD's) are derived, and only as n — > oo 
the measures coincide (this can be seen by approximating V n , see Appendix 10). In the 
current paper, whenever we state a gap from capacity in dB, we refer to the gap (|2TT >. 

In the current paper we shall be interested in the gap to capacity in the forms of (fT9l and 
(|20l . The finite-dimensional results in Section JV] are specific for each n and can be written 
as a function of either the NLD S or the ratio (|22l . However, the asymptotic analysis in 
Sections |V] and [VI] depends on the selected measure. Specifically, in Section [V] we study 
the behavior of the error probability with n — > oo where 6 is fixed. This is equivalent 
to fixing the ratio (|20l (but not (|22l ). While the exponential behavior of the bounds on 
the error probability is the same whether we fix (|20l or (1221 . the sub-exponential behavior 
differs. In Section [VI] we are interested in the behavior of the gap ([19] ) with n — > oo for 
fixed error probability. Equivalent results in terms of the ratio (|22l) can be derived using the 
same toolsQ 

3 For AS measured in bits we would get the familiar 6.02 dB/bit instead of 8.6859 dB/nat in ( 12 1 1 >. 
4 It is interesting to note that although we choose to stick with the gap in nats and to the ratio ( 120b . the term (122) will 
pop out in the asymptotic analysis in Section fVl 
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III. Previous Results 

A. Known Bounds on P e (n, 6) 

Here we review existing non- asymptotic bounds on P e (n,S), and discuss how easy are 
they for evaluation and asymptotic analysis. 

The following non- asymptotic achievability bound can be distilled from Poltyrev's paper 
0: 

Theorem 1 (Poltyrev's achievability): For any r > 0, 

P e (n,S) <e nS nV n w n ~ l Pr{Z e D(r, w)}dw + Pr{||Z|| > r}, (23) 
Jo 

where D(r, w) denotes the section of the sphere with radius r that is cut off by a hyperplane 
at a distance — from the origin. 

In it is stated that the optimal value for r (the one that minimizes the upper bound) 
is given by the solution to an integral equation, and it is shown that as n — > oo, the optimal 
r satisfies — — > a 2 e 2 ( s *~ s \ However, no explicit expression for the optimal r is given, so 
in order to compute the bound for finite values of n one has to numerically optimize w.r.t. 
r (in addition to the numerical integration). In order to derive the error exponent result, 
Poltyrev [0 used the asymptotic (but suboptimal) r = ^/nae s *~ s . 

The converse bound used in [0, which will be used in the current paper as well, is based 
on the following simple fact: 

Theorem 2 (Sphere bound): Let W(s) be the Voronoi region of an IC point s, and let 
Sw(s) denote a sphere with the same volume as W(s). Then the error probability P e (s) is 
lower bounded by 

P e (s) > Pr{Z £ S w(s) }, (24) 
where Z denotes the noise vector. 

This simple but important bound (see, e.g. [03111191 ) is based on the fact that the pdf of the 
noise vector has spherical symmetry and decreases with the radius. An immediate corollary 
is the following bound for lattices (or more generally, any IC with equal-volume Voronoi 
cells): 

poo 

Pe(n,S) > P e SB (n,S) 4 p r {||Z|| > r cS } = / f R (r')dr', (25) 

where r e s is the radius of a hypersphere with the same volume as a Voronoi cell, and fii(r) 
is the pdf of the norm of the noise vector, i.e. a (normalized) Chi distribution with n degrees 
of freedom. 

Note that this bound holds for any point s in the IC, therefore it holds for the average 
error probability P e (n,5) (and trivially for the maximal error probability as well). In O 
the argument is extended to IC's which not necessarily obey the constant volume condition 
in the following manner: first, it is claimed that there must exist a Voronoi region with 
volume that is at less than the average volume so the bound holds for P e max (5). In 
order to apply the bound to the average error probability, a given IC S with average error 
probability e is expurgated to get another IC S' with maximal error probability at most 2s. 
Applying the previous argument for the maximal error probability of S' gives a bound on 
the average error probability of S. The expurgation process, in addition to the factor of 2 
in the error probability, also incurs a factor of 2 loss in the density 7. When evaluating 
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the asymptotic exponential behavior of the error probability these factors have no meaning, 
but if we are interested (as in the case in this paper) in the bound values for finite n, and 
in the asymptotic behavior of S e (n), these factors weaken the sphere bound significantly. 
In Section [IV] we show that (1231) holds verbatim for any finite dimensional IC, and for the 
average error probability as well. 

The sphere bound (1231) includes a simple (but with no known closed-form solution) ID 
integral and can be evaluated numerically. An alternative for the numerical integration was 
proposed in [fl31 , where the integral was transformed into a sum of n/2 elements to allow the 
exact calculation of the bound. While the result gives an alternative to numeric integration, 
it does not shed any light on the asymptotic behavior of the bound with growing n. 

B. Known Asymptotic Bounds at Fixed 8 (Error Exponent) 

The error exponent E(<5) for the unconstrained AWGN was defined in ©. The nonasymp- 
totic bounds in the previous subsection can lead to upper and lower bounds on the exponent. 

The asymptotic evaluation of Poltyrev's achievability bound (Theorem H) is hard: in []3j , 
in order to provide a lower bound on the error exponent, a suboptimal value for r is chosen 
for finite n (r = y/nae^^ 3 *^ 6 ^. The resulting bound is the random coding exponent for 
this setting E r (<5), given by 

f r-tf + logf, 6<d cr ; 
E r (S)={ \ [e 2 ^*- 5 ) - 1 - 2(6* - 6)} , d cr <5<6*; (26) 
{ 0, 6 > 6*, 

where S cr = | log 4 * 2 . Poltyrev also provided an expurgation-type argument to improve 
the error exponent at low NLD values (below 5 ex = S* — log 2). This NLD region is outside 
the focus of the current paper. 

An upper bound on the error exponent is the sphere packing exponent. It is given by 0: 

E sp (S) = l - [e* s *-V - 1 - 2(6* - 6)] , (27) 

which is derived from the sphere bound (see [3, Appendix C]). 

The upper and lower bounds on the error exponent only hint on the value of P e (n, S): 

e -n(E 8p (5)+ o( l)) < < e -„(E r (5)+ (l))_ (2g) 

Even when the error exponent bounds coincide (above the critical NLD S cr ), the optimal 
error probability P e (n,S) is known only up to an unknown sub-exponential term. In Sec- 
tion |V] we present a significantly tighter asymptotic analysis and show, for example, that at 
NLD above 6 cr , P e (n, S) is known, asymptotically, up to a constant. 

IV. Bounds for Finite Dimensional IC's 

In this section we analyze the optimal performance of finite dimensional infinite constel- 
lations in Gaussian noise. We describe two new achievability bounds, both based on lattices: 
The first bound is based on a simple 'typicality' decoder, and the second one based on the 
ML decoder. Both bounds result in simpler expressions than Poltyrev's bound (Theorem [T). 
The first bound is simpler to derive but proves to be weak. The second bound gives the 
exact value of the bound as Poltyrev's (Theorem [Q, without the need for 3D integration and 
an additional numeric optimization, but only a single ID integral (which can be analyzed 
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further - see Section [V). As for converse bounds, we extend the validity of the sphere 
bound to the most general case of IC's (not only those with equal-volume Voronoi cells) 
and average error probability. 

A. Typicality Decoder Based Bound 
Theorem 3: For any r > 0, 

P e {n, 6) < Pj B ± e n5 V n r n + Pr {||Z|| > r} , (29) 

and the optimal value for r is given by 



r* = ay/n(l + 28* -26). (30) 

Proof: Let A be a lattice that is used as an IC for transmission over the unconstrained 
AWGN. We consider a suboptimal decoder, and therefore the performance of the optimal 
ML decoder can only be better. The decoder, called a typicality decoder, shall operate as 
follows. Suppose that A G A is sent, and the point y = A + z is received, where z is the 
additive noise. Let r be a parameter for the decoder, which will be determined later on. 
If there is only a single point in the ball Ball(y,r), then this will be the decoded word. 
If there are no codewords in the ball, or more than one codeword in the ball, an error is 
declared (one of the code points is chosen at random). 

Lemma 1: The average error probability of a lattice A (with the typicality decoder) is 
bounded by 

P e (A) < Pr{Z £ Ball(r)} + ^ Pr {Z G Ball(A, r) fl Ball(r)} , (31) 

AeA\{0} 

where Z denotes the noise vector. 

Proof: Since A is a lattice we can assume without loss of generality that the zero point 
was sent. We divide the error events to two cases. First, if the noise falls outside the ball 
of radius r (centered at the origin), then there surely will be erroneous decoding since the 
transmitted (0) point is outside the ball. The remaining error cases are where the noise Z 
is within Ball(r), and the noise falls in the typical ball of some other lattice point (that is 
different than the transmitted zero point). We therefore get 



P e (A) < Pr {Z i Ball(r)} + Pr I Z G Ball(r) p| 



U Ball(A, 

AeA\{0} 



= Pr {Z £ Ball(r)} + Pr < Z G (J Ball(A, r) n Ball(? 

I AeA\{0} 

< Pr {Z i Ball(r)} + Pr {Z G Ball(A, r) fl Ball(r)} , (32) 

AeA\{0} 

where the last inequality follows from the union bound. ■ 
We use the Minkowski-Hlawka theorem lfl4lllfT3~ll : Fl 

5 The MH theorem is usually written as d33> with an e added to the RHS that is arbitrarily small (e.g. 1131 Lemma 3, 
p. 65], and [14 Theorem 1, p. 200]). The version ((33} follows from a slightly improved version of the theorem due to 
Siegel, often called the Minkowski-Hlawka-Siegel (MHS) theorem, see 1141 Theorem 5, p. 205]. 
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Theorem 4 (MH): Let / : R n — > R + be a nonnegative integrable function with bounded 
support. Then for every 7 > 0, there exist a lattice A with det A = 7 _1 that satisfies 

^ 7 / /(A)dA. (33) 



AeA\{0} 



Since Pr{Z G Ball(A,r) nBall(r)} = for any A s.t. ||A|| > 2r we may apply the MH 
theorem to the sum in (l3~2~i We deduce that for any 7 > 0, there must exist a lattice A with 
density 7, s.t. 

Pr{Z G Ball(A,r) nBall(r)} < 7 / Pr {Z G Ball(A, r) fl Ball(r)} dX. (34) 

AeA\{0} At" 

We further examine the resulting integral: 



Pr {Z G Ball(A, r) n Ball(r)} dA 



fz(z)dzdX 

R n JBalXA,r)nBall{r) 

< / / f z (z)dzdX 

JR n */Ball(A,r) 

/ z (z' + X)dz'dX 



E n ^Ball(r) 

ldz' 



Ball(r) 

= K.r". (35) 
Combined with (|3"TT) we get that there exist a lattice A with density 7, for which 

Pe(A-) <7Kr n + Pr{||Z|| >r}, (36) 

where r > and 7 = e nS can be chosen arbitrarily. 

The optimal value for r follows from straightforward optimization of the RHS of (1361 ): 
we first write 



Pr i II Z II > r 



We note that the sum -^ YH=i ^1 ls a sum °f n i-i-d- standard Gaussian RV's, which is 
exactly a % 2 random variable with n degrees of freedom. The pdf of this RV is well known, 
and given by 

n-n/2 



fxl( x ) 



_ x n/2-l e -x/2 



r(n/2)" 

where T(-) is the Gamma function. Equipped with this, the RHS of (l36l) becomes 



OO Q — 



< ! " 5 VnT n + I 2 ^S^ 2 - 1 ^ 2 - 

'ri T(n/2) 
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Differentiating w.r.t. r and equating to zero gives 

ne nS V n r^ - ^^™(r 2 /a 2 )"/ 2 "^"^ = 
a z 1 yn/z) 

We plug in the expression for V n = and get 

fr(n/2) cH r(n/2) 



which simplifies to the required r = cry n(l + 2<5* — 2<5). ■ 

5. ML Decoder Based Bound 

The second achievability bound is based on the ML decoder (using a different technique 
than Poltyrev (31): 

Theorem 5: For any r > and dimension n, there exist a lattice A with error probability 

P e (n,S) <P e MLB (n,S) ±e n8 V n f R (r)r n dr + Pr {\\Z\\ > r} , (37) 

Jo 

and the optimal value for r is given by 

r* = r cff = e~V- 1/n . (38) 

Before the proof, note that this specific value for r gives a new interpretation to the bound: 
the term Pr {||Z|| > r} is exactly the sphere bound (l24t . and the other term can be thought 
of as a 'redundancy' term. Making this value small results in tightening of the gap between 
the bounds. 

Proof: Suppose that the zero lattice point was sent, and the noise vector is z e R". An 
error event occurs (for a ML decoder) when there is a nonzero lattice point A G A whose 
Euclidean distance to z is less than the distance between the zero point and noise vector. 
We denote by 8 the error event, condition on the radius R of the noise vector and get 

P e (A) = Pr{£} = 

= E R [Pr{£\ \\Z\\=R}} 

POO 

= / f R (r)Pi{£ | ||Z|| =r}dr 
Jo 

< f R (r) Pr {£ | ||Z|| =r}dr + Pr{||Z|| > r*}, (39) 
Jo 

where the last inequality follows by upper bounding the probability by 1. It holds for any 

r* > 0. 

We examine the conditional error probability Pr {£ \ ||z|| = r}: 

Pr{£ | ||Z|| = r} = Pr I |J ||Z-A||<||Z| 

[aga\{o} 

< Y Pr {ll Z - A ll < ll Z ll I ll Z ll = r ) 

aga\{o} 

= Pr {A G Ball(Z, ||Z||) | ||Z|| = r} , (40) 

AeA\{0} 
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where the inequality follows from the union bound. Plugging into the left term in (|39l ) gives 



f R (r) Pr{AGBaU(Z, ||Z||) | ||Z|| =r}dr 

AeA\{0} 



J2 I M r ) Pr{A G Ball(Z, ||Z||) | \\Z\\=r}dr. 

AeA\{0} " 



(41) 



Note that the last integral has a bounded support (w.r.t. A) - it is always zero if ||A|| > 2r*. 
Therefore we can apply the Minkowski-Hlawka theorem as in Theorem [3] and get that for 
any 7 > there exists a lattice A with density 7, whose error probability is upper bounded 
by 



P e (A)<7 / / /R(r)Pr{AeBaU(Z, 
J AeR n Jo 



r}drdA + Pr{||Z|| > r*}. 



We continue with 



/ / Mr) Pr {A <EBall(Z, ||Z||) | ||Z|| =r}drd\ 
J AeR n Jo 



fn(r 
f R (r 
fn(r)E 



Pr{A G Ball(Z, ||Z| 



AeR" 



AeR n 



E [l 



{AeBall(Z,||Z||)} 



-{AGBall(Z,||Z||)} 



dX 



LJ\eR n 

/ K (r)E[||Z|| n K| ||Z||=r]dr 
V n f f R (r)r n dr, 



|Z|| = r} dXdr 
= r] dXdr 
dr 



and we obtain (1371) . 

To find the optimal value for r (the one that minimizes the RHS of (f37l)). we see that: 



(42) 



Pr{||Z|| >r}= f R (f)df. 

J r 

Differentiating the RHS of (1371) w.r.t. r in order to find the minimum gives 

e nS V n f R (r)r n - f R (r) = 0, 
and r* = r cff = e~ s V n T 1 ^™ immediately follows. 



(43) 



C. Equivalence of the ML bound with Poltyrev 's bound 

In Theorems [3] and [5] we provided a new upper bounds on the error probability that 
were simpler than Poltyrev's original bound (Theorem [T). For example, in order to compute 
Poltyrev's bound, one has to apply 3D numerical integration, and numerically optimize w.r.t. 
r. In contrast, both new bounds requires only a single integration, and the optimal value 
for r has a closed-form expression so no numerical optimization is required. 
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It appears that the simplicity of the bound in Theorem [5] does not come at a price of a 
weaker bound. In fact, it proves to be equivalent to Poltyrev's bound: 

Theorem 6: Poltyrev's bound (Theorem [T) for the error probability, for the optimal value 
of r, is equal to the ML bound from Theorem |5] 



ze nS 



where r* = r e g = e s V n 1 ^ n . 



mm^e nS nV n J^ w n ~ l Pr{Z G D(r, w)}dw + Pr{||Z|| > r} 

V n [ f R (p)p n dp + Pr {||Z|| >r*}, (44) 
Jo 



In fact, we can strengthen (1441) and show that 

/ w n ~ l Pr{Z G D(r, w)}dw = jV n / f R (p)p n dp (45) 
Jo Jo 



-2r 

jnV n 



for any r > 0. 

Proof: Appendix lAl ■ 
Note that proving (1431) shows that both bounds are equivalent, regardless of the value of r. 
Consequently, the optimal value for r in Poltyrev's bound is also found. In [3] the optimal 
value (denoted there d c (n,5)) was given as the solution to an integral equation, and was 
only evaluated asymptotically. 



D. The Sphere Bound for Finite Dimensional Infinite Constellations 

The sphere bound (1251) applies to infinite constellations with fixed Voronoi cell volume. 
Poltyrev [fJl extended it to general IC's with the aid of an expurgation process, without 
harming the tightness of the error exponent bound. When the dimension n is finite, the 
expurgation process incurs a non-negligible loss (a factor of 2 in the error probability and 
in the density). In this section we show that the sphere bound applies without any loss to 
general finite dimensional IC's and average error probability. 

We first concentrate on IC's with some mild regularity assumptions: 

Definition 3 (Regular IC's): An IC S is called regular, if: 

1) There exists a radius r > 0, s.t. for all s G S, the Voronoi cell W(s) is contained in 
Ball(s,r ). 

2) The density 7(5) is given by lim^oo M( f n ' a ^ (rather than limsup in the original 
definition). 

For s G S, we denote by v(s) the volume of the Voronoi cell of s, \W(s)\. 
Definition 4 (Average Voronoi cell volume): For a regular IC <S, the average Voronoi cell 
volume is defined by 

v(S) = limsup E [u(s)]. (46) 

a— >oo 

Lemma 2: For a regular IC S, the average volume is given by the inverse of the density: 



7(5) = -L^. (47) 



Proof: Appendix HH 
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For brevity, let SPB(d) denote the probability that the noise vector Z leaves a sphere of 
volume v. With this notation, the sphere bound reads 

P e (s) > SPB(y(s)), (48) 

and holds for any individual point s E S. We also note the following: 

Lemma 3: The equivalent sphere bound SPB(t> ) is convex in the Voronoi cell volume v. 
Proof: Appendix O 

We now show that the above equation holds for the average volume and error probability 
as well. 

Theorem 7: Let S be a regular (finite dimensional) IC with NLD 5, and let v(S) be the 
average Voronoi cell volume of S (so the density of S is 7 = v(S)~ 1 ). Then the average 
error probability of S is lower bounded by 

P e (S) > SPB(«(5)) = SPB( 7 - 1 ) = P e SB (n, S). (49) 

Proof: We start with the definition of the average error probability and get 

P e {S) = limsupE a [P e ( S )] 

a— too 

(a) 

> limsupE a [SPB(w(s))] 

a— >oo 

(6) 

> limsupSPB(E>(s)]) 

a— >oo 

= SPB(limsupE>(s)]) 

a— >oo 

= sm(v(S)). (50) 

(a) follows from the sphere bound for each individual point s 6 S, (b) follows from the 
Jensen inequality and the convexity of SPB(-) (Lemma [3]), and (c) follows from the fact 
that SPB(-) is continuous. ■ 
As a consequence, we get that the sphere bound holds for regular IC's as well, without the 
need for expurgation (as in [0). 

So far the discussion was constrained to regular IC's only. This excludes constellations 
with infinite Voronoi regions (e.g. contains points only in half of the space), and also 
constellations in which the density oscillates with the cube size a (and the formal limit 7 
does not exist). We now extend the proof of the converse for any IC, without the regularity 
assumptions. The proof is based on the following regularization process: 

Lemma 4 (Regularization): Let S be an IC with density 7 and average error probability 
P e (S) = e. Then for any £ > there exists a regular IC S' with density 7' > 7/(1 + £), 
and average error probability P e (S') — e' < e(l + £). 

Proof: Appendix [Ql ■ 

Theorem 8 (Sphere Bound for Finite Dimensional IC's): Let S be a finite dimensional 
IC with density 7. Then the average error probability of S is lower bounded by 

P e (S) > SPB( 7 - 1 ) = P e SB (n, S) (51) 

Proof: Let £ > 0. By the regularization lemma (Lemma H) there exists a regular IC S' 
with Y > 7/(1 + £), and P e (S') < P e (S)(l + 0- We apply Theorem □ to S' and get that 

P e (S)(l + > P e (S') > SPB( 7 '- 1 ) > SPB((1 + 07" 1 ), (52) 
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Fig. 2. Numerical evaluation of the bounds for S = — 1.5nat with a 2 = 1 (0.704db from capacity). From bottom to 
top: Solid - the sphere bound (Theorem [2}- Gray - the ML bound (Theorem |5j- Dashed - Poltyrev's bound (Theorem [T). 
Dot-dashed - the typicality-based achievability bound (Theorem [3} . 



or 



i 3 e(5)> r ^SPB((l+07" 1 ), (53) 
for all £ > 0. Since SPB(-) is continuous, we may take the limit £ — > and get to (I5TI ). ■ 



E. Numerical Comparison 

Here we numerically compare the bounds in this section with Poltyrev's achievability 
bound (Theorem [T). As shown in the previous subsection, the bounds in Theorems \T\ and |5] 
are equivalent. However, as discussed following the statement of Theorem \T\ above, in [|3] 
the suboptimal value for r is used. 

We therefore refer to the achievability bound in Theorem Q] (or Theorem |5]) with r = 
y/nae s *~ s as 'Poltyrev's bound'. The results are shown in Figures |2]and[3] The exponential 
behavior of the bounds (the asymptotic slope of the curves in the log-scale graph) is 
clearly seen in the figures: at NLD above d cr , the sphere bound and the ML and Poltyrev's 
achievability bounds have the same exponent, while for NLD below S cr the exponent of 
the sphere bound is better. In both cases the typicality bound has a weaker exponent. These 
observations are corroborated analytically in Section [V] below. 

V. Analysis and Asymptotics at Fixed NLD 6 

In this section we analyze the bounds presented in the previous section with two goals 
in mind: 
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Fig. 3. Numerical evaluation of the bounds for S — — 2nat with a 2 = 1 (5.05db from capacity). From bottom to top: 
Solid - the sphere bound (Theorem |2}- Gray - the ML-based achievability bound (Theorem |5j- Dashed - Poltyrev's bound 
(Theorem [T}. Dot-dashed - the typicality-based achievability bound (Theorem [5}. 



1) To derive tight analytical bounds (that require no integration) that allow easy evaluation 
of the bounds, both upper and lower. 

2) To analyze the bounds asymptotically (for fixed 8) and refine the error exponent results 
for the setting. 

In IV-AI we present the refined analysis of the sphere bound. While the sphere bound 
P^ B will present the same asymptotic form for any 8, the ML bound P^ ILB has a different 
behavior above and below 8 cr . In IV-BI we focus on the ML bound above 8 cr . The tight 
results from IV- Al and IV-BI reveal that (above 8 cr ) the optimal error probability P e (n, 6) is 
known asymptotically up to a constant. This is discussed in IV-CI In IV-DI we focus on the 
ML bound below 8 cr , and in IV-EI we consider the special case of 8 = S cr . In IV-FI we study 
the asymptotics of the typicality bound P e T (n, 8) and in IV-GI we analyze Poltyrev's bound, 
i.e. the ML bound with r set to r = y/nae s *~ s instead of r cS . 

The fact that the ML bound behaves differently above and below 8 cr can be explained 
by the following. Consider the first term in the ML bound, e nS V n J^ cB fn(r)r n dr. Loosely 
speaking, the value of this integral is determined (for large n) by the value of the integrand 
with the most dominant exponent. When 8 > 8 cr , the dominating value f or the integral is 
at r = r eff . For 8 < 8 cr , the dominating value is approximately at r = \/2na 2 . Note that 
this value does not depend on 8, so the dependence in 8 comes from the term e nS alone, 
and the exponential behavior of the bound is of a straight line. Since we are interested in 
more than merely the exponential behavior of the bound, we use more refined machinery 
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in order to analyze the bounds. 

Poltyrev (3l used an expurgation technique in order to improve the error exponent for 
lower NLD values (below 8 ex = 6* — log 2). The refined tools used here can also be applied 
to the expurgation bound in order to analyze its sub-exponential behavior. However, in this 
region the ratio between the upper and lower bounds grows exponentially, and therefore the 
sub-exponential analysis of the expurgation bound is of little interest and is not included in 
this paper. 



A. Analysis of the Sphere Bound 

The sphere bound (Theorem [2J is a simple bound based on the geometry of the coding 
problem. However, the resulting expression, given by an integral that has no elementary 
form, is generally hard to evaluate. There are several approaches for evaluating this bound: 

• Numeric integration is only possible for small - moderate values of n. Moreover, the 
numeric evaluation does not provide any hints about the asymptotical behavior of the 
bound. 

• Tarokh et al. [15] were able to represent the integral in the bound as a sum of n/2 
elements. This result indeed helps in numerically evaluating the bound, but does not 
help in understanding its asymptotics. 

• Poltyrev [|3l used large-deviation techniques to derive the sphere packing error exponent, 
i.e. 



The error exponent, as its name suggests, only hints on the exponential behavior of the 
bound, but does not aid in evaluating the bound itself or in more precise asymptotics. 

Here we derive non-asymptotic, analytical bounds based on the sphere bound. These 
bounds allow easy evaluation of the bound, and give rise to more precise asymptotic analysis 
for the error probability (where 8 is fixed). 

Theorem 9: Let r* = r cS = e- s Vn 1/n , p* = % and T = n(p *" 1+ " ) . Then for any NLD 
8 < 8* and for any dimension n > 2, the sphere bound P^ B (n, 8) is lower bounded by 



lim — log P e (n, 8) < E sp (8) = - [e 2 ^ - 1 - 2(8* - 8)} . (54) 




(55) 



(56) 



upper bounded by 



pSB 



(n,S) < 



e n(6*-S) e n/2 e -%p* 



(57) 



e 




and for fixed 8, given asymptotically by 




(58) 



Some notes regarding the above results: 
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Eq. (1551) provides a lower bound in terms of the Q function, and (1561 ) gives a slightly 
looser bound, but is based on elementary functions only. 

The upper bound (|57l ) on the sphere bound has no direct meaning in terms of bounding 
the error probability P e (n, S) (since the sphere bound is a lower bound). However, it 
used for evaluating the sphere bound itself (i.e. to derive (|58l) ). and it will prove useful 
in upper bounding P e (n, S) in Theorem ITOl below. 

A bound of the type (1571) . i.e. an upper bound on the probability that the noise leaves 

a sphere, can be derived using the Chernoff bound as was done by Poltyrev [3l 

Appendix B]. However, while Poltyrev's technique indeed gives the correct exponential 

behavior, it falls short of attaining the sub-exponential terms, and therefore (|57t is 

tighter. Moreover, (|57l ) leads to the exact precise asymptotics (1581) . 

(1581) gives an asymptotic bound that is significantly tighter than the error exponent term 

alone. The asymptotic form (1581 ) applies to (1551 ), (1561 ) and (1571 ) as well. 

Note that p* is a measure that can also quantify the gap from capacity (see III-BI) . It is 

an alternative to Ad = S* — d (or to p = e 2AS ). The measures are not equivalent, but 

as n ->■ oo we have p* = e 2(<r ~ <5) + o(l), see d65j and d66j) below. 



Proof: We write the sphere bound explicitly: 

Pf B (n,S) = Pr{||Z|| > r*} 
f R {r')dr' 



fxl(p) d P 

r* 2 /a 2 

2~i r °° 



2 -f n n/2 roc 



p %-l e -np/2 dp 



(59) 



In order to evaluate the integral in (1591 we require the following lemma. 
Lemma 5: Let n > 2 and x > 1 — - . Then the integral p^^e'^^dp can be bounded 
from above by 



n nx 



p ^-l e -np/2 df) < 



2x2 e 2 
n(x — 1 + 



and from below by 



'II X 

2 



p2 1 e np / 2 dp >2x 2 e~ 2 exp 
2x2e 2 



7T 



n - 2 



Q(T) 



> 



TMX — 1 + 



1 



n nx 



> 



2x 2 e 2 
n(a; — 1 + 



1 + T- 2 
1 



1 



f2 I ' 



(60) 

(61) 
(62) 
(63) 



where T 
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Proof: Appendix ■ 
We continue the proof of the theorem: (l55"b follows by plugging (|6TI) into (|59| ) with 
x — p*. It can be shown that p* > 1 for all <5 < 5* so the condition a; > 1 — - is met. (l56l) 
follows similarly using (|62l ) and the definition of 5*. The upper bound (1571 ) follows using 
©. 

To derive (|58l) we first note the following asymptotic results: 



7T 



n/2 



2 V2- 



2vre 



n 



n/2 



1 + 



(64) 



-2d 



V n 



-2/n 



1 + - 



rr 



,2(5* -5) 



n 



log(n7r) + O 



log 2 n 



n- 



T 



n(p* 



1 + 



V 2 ( n - 2) 



SO 



3 2(5*-5) 



1) 1 + 



logn 



n 



(65) 
(66) 

Q(Vn). (67) 



For (|64l see Appendix |F] (|65l ) follows from (|64l and the definition of 5*. (|66l) follows by 
writing (nvr) 1 /™ = en'^W and the Taylor approximation. (l67l follows directly from (|66l) . 
We evaluate the term e~5 p * in (l56l) and (1571): 



exp 



,2(<5*-<5) 



1 i /- ^ , n ( lo S 2 71 
\.og{nix) + C 



_n 2(«*-«) 

e 2 exp 



_n 2(5* -S) 



[nil) 



2 

i„a(a 



log 2 n 



n 



-S) 



1 + 



log n 



n 



(68) 



Plugging (|66|) . (1671) and ([685 into Q and (I57T) . along with the definition of E sp (5), leads 
to the desired (l58i ■ 
In Fig. |4] we demonstrate the tightness of the bounds and precise asymptotics of Theo- 
rem [9] In the figure the sphere bound is presented with its bounds and approximations. The 
lower bound (1551) is the tightest lower bound (but is based on the non-analytic Q function). 
The analytic lower bound (|56l ) is slightly looser than (|55l , but is tight enough in order 
to derive the precise asymptotic form (|58l l. The upper bound (|57l) of the sphere bound is 
also tight. The error exponent itself (without the sub-exponential terms) is clearly way off, 
compared to the precise asymptotic form <j58j . 



B. Analysis of the ML Bound Above 8 cr 

In order to derive the random coding exponent E r (<5), Poltyrev's achievability bound 
(Theorem [Q was evaluated asymptotically by setting a suboptimal value s/nae^^ 5 *^ 5 ^ for 
the parameter r. While setting this value still gives the correct exponential behavior of the 
bound, a more precise analysis (in the current and following subsections) using the optimal 
value for r as in Theorem |5] gives tighter analytical and asymptotic results. 
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Fig. 4. Numerical evaluation of the sphere bound and its bounds and approximation in Theorem [9] vs the dimension 
n. Here S = — 1.5nat and a 2 — 1 (0.704db from capacity). The tight bounds l !55t . d56t and l !57t lead to the asymptotic 
form ((58}. The error exponent term alone is evidently way off compared to 



Theorem 10: Let r* = r cS = e - s Vn 1/n , p* = 4 J 



and 3> 



y/2(n-2) * 2 v / P 5r 

Then for any NLD S and for any dimension n > 2 where 1 — ^ < p* < 2 — -, the ML 
bound P^ ILB (n, S) is upper bounded by 



n(<5*-<5) n/2 -§p* 

P e MLB (n,S) < -r-^ J-^ ^, 



(69) 



lower bounded by 



P e MLB (n,S) >e n(d "W 



> e n(5*-5) e n/2 e -np*/2 



l/ 2p* VV ; V n-2 



n 2 TT 



Q(T) 



2 - p* + 2 1 + ^- 2 p* - 1 + 2 1 + T" 



and for S cr < S < 5*, given asymptotically by 



e -nE r (5)/„_\-i R 2 (< 5 *-< 5 ) 



(2 - e 2(«*-«)) (e 2 ^*- 5 ) - 1) 
Some notes regarding the above results: 



l + O 



log 2 n 



n 



(70) 



(71) 



(72) 
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• For large n, the condition p* < 2 — - translates to the fact that S cr < S. p* > 1 — - 
holds for all 6 < 5*. The case of 6 < S* is addressed later on in the current section. 

• The lower bounds d70l and (|7TI) have no direct meaning in terms of bounding the error 
probability P e (n, S) (since they lower bound an upper bound). However, they are useful 
for evaluating the achievability bound itself (i.e. to derive (1721)). 

• (|72l) gives an asymptotic bound that is significantly tighter than the error exponent 
term alone. It holds above the 6 cr only, where below 6 cr and exactly at 5 cr we have 
Theorems [TT] and \Y2\ below. The asymptotic form (1721 applies to (l69l) , (1701) and (1711) 
as well. 

Proof: The proof relies on a precise analysis of the ML bound: 



The second term is exactly the sphere bound, which allows the usage of the analysis of 
Theorem |9j We therefore proceed with analyzing the first term : 




(73) 






*2 



(74) 



We need the following lemma: 
Lemma 6: Let < x < 2 — -. 



Then the integral J* e np l 2 p n 1 dp is upper bounded by 




(75) 



and is lower bounded by 




(76) 



2x n e -nx/2 1 



(77) 



> 



(2-x + l) + * 



-2' 



n 




Proof: Appendix E 
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To prove the upper bound (|69l we use (1751 ) with x = p* to bound (1741 ): 

- n5 V n [ f R (r)r n dr = -e n ^ s+sm) V^e n/2 cT 2n n n / e~ np/2 ! p n-1 dp (78) 

21 * 

< ^"(W*)^ e n /W • 2 ^" e " 2 ' (79) 
2 ' n ( 2 -p*--) 



2 - p* - 1 



(80) 



We combine the above with the upper bound (p7l) on the sphere bound and get 



p n{5*-S) n/2 -^P* p n(S*-S) n/2 -f p * 

e"V n / / fl ( r )r»dr + Pr{||Z||>r*}<— 3— + — — , , (81) 

2 — p* — - p* — 1 + - 







which immediately leads to (1691) . 

In order to attain the lower bound (|70l we use (|76T ) with x = p* and get that e n<5 Ki J Q r fn(r)r 
is lower bounded by 

n(5*-5)n/2-np*/2 . * 2 /2 



Eq. (1701 ) follows by using the lower bound (1551 ) on the sphere bound. The analytic bound 
dZB follows from d77j. 

The asymptotic form (1721 follows by the fact that ^ = 0(y / n), and by plugging (l66l) 
and d67j into the analytical bounds ([69]) and (fTTT) . ■ 

In Fig. [5] we demonstrate the tightness of the bounds and precise asymptotics in Theo- 
rem (TO] In the figure the ML bound is presented with its bounds and approximations. The 
image is similar to the Fig. @] referring to the sphere bound. The lower bound (ITOl is the 
tightest lower bound (but is based on the non-analytic Q function). The analytic lower bound 
dTTb is slightly looser than (1701 ), but is tight enough in order to derive the precise asymptotic 
form (1721 . The upper bound (|69l of the sphere bound is also tight. The error exponent itself 
(without the sub-exponential terms) is clearly way off, compared to the precise asymptotic 
form dTJ). 



C. Tightness of the Bounds Above 5 cr 

Corollary 1: For S cr < 6 < 8* the ratio between the upper and lower bounds on P e (n, 6) 
converges to a constant, i.e. 

P e MLB (n,S) _ 1 in f^n\ 

P e SB (n,6) (2-e 2 (< r -< 5 )) V n )' { } 

Proof: The proof follows from Theorems [9] and [10] Note that the result is tighter than 
the ratio of the asymptotic forms d58j and ([72]) (i.e. O(^p) and not 0(^^)) since the 
term that contributes the log 2 n term is e~^ p * which is common for both upper and lower 
bounds. ■ 
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Fig. 5. Numerical evaluation of the ML bound and its bounds and approximation in Theorem [10] vs the dimension n. 
Here 8 — — 1.5nat (0.704db from capacity). The tight bounds ( 169) . HO) and d71| l lead to the asymptotic form j72\ . The 
error exponent term alone is evidently way off compared to (17 21 . 



D. The ML Bound Below S cr 

Here we provide the asymptotic behavior of the ML bound at NLD values below S c 
Theorem 11: For any <5 < S cr , the ML bound can be approximated by 

e -nE r (<5) 



iMLB, 



n,S) 



V2 



Tin 



(i + o(i)). 



(83) 



Proof: We start as in the proof of Theorem |5] to have 



e nS V n [ f R {r)r n dr = ^e nS V*a n (2n)-%n n f e - np/2 p n ~ x dp. (84) 
Jo 2 J 

We continue by approximating the integral as follows: 

Lemma 7: Let x > 2. Then the integral J* e~ np l 2 p n ~ 1 dp can be approximated by 



(85) 



Proof: The proof relies on the fact that the integrand is maximized at the interior of 
the interval [0,x\. Note that the result does not depend on x. 
We first rewrite the integral to the form 

i e -nW2-logp) d = f g ( p ) e -nG(p) dp ^ (g6) 

P Jo 
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where g(p) = - and G(p) = p/2 — log p. 

When n grows, the asymptotical behavior of the integral is dominated by the value of 
the integrand at p = 2 (which minimizes G(p)). This is formalized by Laplace's method of 
integration (see, e.g. [|20j Sec. 3.3]): 



X g(p)e-^dp = g(p)e-^\l-^— (l + Q (A)) 



-Qp~\p=p 



= i rf *-*Wi? f(1+0( i ))i 

which leads to ([85]). ■ 
Before we apply the result of the lemma to (1841 ), we note that whenever S is below the 
critical 6 cr , p* > e 2 ^* - * 5 ) = 2e 2{ - Scr ~ 5 ^ > 2 for all n. Therefore for all n we have 

2e 2(S cr -8) * 

e- np/2 p n ~ l dp< / e~ np/2 p n - l dp < / e~ np/2 p n - l dp. (87) 
We apply Lemma [7] to both sides of the equation and conclude that 

J* e- np l 2 p n - x dp = y^V n 2 n (l + O (i)) . (88) 



The proof of the theorem is completed using the approximation (1641) for V n . 

It should be noted that the sphere bound part of the achievability bound vanishes with a 
stronger exponent (E sp (S)), and therefore does not contribute to the asymptotic value. ■ 

In Fig. [6] we demonstrate the tightness of the precise asymptotics in Theorem [TT] Here 
too the precise asymptotic form is significantly tighter than the error exponent only. 



E. The ML Bound at 6 cr 

In previous subsections we provided asymptotic forms for the upper bound on P e (n, d), 
for 6 > 8 cr and for 8 < S cr (Theorems \T0\ and [TT] respectively). Unfortunately, neither 
theorem holds for S cr exactly. We now analyze the upper bound at <5 cr , and show that its 
asymptotic form is different at this point. As a consequence, at the critical NLD, the ratio 
between the upper and lower bounds on P e (n,d) is of the order of \fn (this ratio above 
6 cr is a constant, and below 6 cr the ratio increases exponentially since the error exponents 
are different). 



Theorem 12: At 8 = S cr , the ML bound is given asymptotically by 

1 



)MLB , 



n, 6 cr ) 



-nE r (5 cr ) _ 



2tt 

nE r (<5 cr ) 1 (l + O ( logn 

V8^ V V ^ 



7i log(n7re 2 ) 
2n n 




(l + 0(k^)) (89) 

(90) 



Proof: Appendix [Gl 

In Fig. [7] we demonstrate the tightness of the precise asymptotics of Theorem H2] 
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Fig. 6. Numerical evaluation of the ML bound and its approximation in Theorem [TT] vs the dimension n. Here S — 
— 1.8nat (3.31db from capacity). The precise asymptotic form 1 183) is clearly tighter than the error exponent only. 



F. Asymptotic Analysis of the Typicality Bound 

The typicality upper bound on P e (n,S) (Theorem [3]) is typically weaker than the ML- 
based bound (Theorem |5]). In fact, it admits a weaker exponential behavior than the random 
coding exponent E r (<5). Define the typicality exponent E t (<5) as 

E t {d) 4 d* - 5 - ~ log(l + 2(6* - 6)). (91) 
Theorem 13: For any d < S*, the typicality upper bound is given asymptotically by 



Proof: Appendix [H] ■ 
The error exponent E t (<5) is illustrated in Figure |8] As seen in the figure, E t (<5) is lower 
than E r (<5) for all 5. 



G. Asymptotic Analysis of P^ ILB with Poltyrev's r = y/nae 5 * 6 

In Poltyrev's proof of the random coding exponent [3], the suboptimal value for r was 
used, cf. Section [IV] above. Instead of the optimal r = r eff = e~ 5 Vn n , he chose r = 
y/nae s *~ s . In Figures [2] and [3] above we demonstrated how this suboptimal choice of r 
affects the ML bound at finite n. In the figures, it is shown that for 8 = — 1.5nat (above 
6 cr ) the loss is more significant than for S = — 2nat (below 6 cr ). Here we utilize the 



2S 
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Fig. 7. Numerical evaluation of the ML bound at S = <5 cr (3.01db from capacity) and its approximations in Theorem 1 121 
vs the dimension n. The asymptotic form d89t is tighter than the simpler ( 190 1 . Both forms approximate the true value of 
the ML bound better than the error exponent term alone. 




Fig. 8. Error exponents for the unconstrained AWGN channel. The typicality error exponent Et(<5) (dot-dashed) vs. the 
random coding exponent E r (<5) (dotted) and the sphere packing E sp (<5) (solid). The noise variance a 2 is set to 1. 
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techniques used in the current section in order to provide asymptotic analysis of the ML 
bound with the suboptimal r, and by that explain this phenomenon. 

Theorem 14: The ML bound p* ILB , with r = ^ae s *~ s , denoted P e MLB (n, S), is given 
asymptotically as follows: 
For 8„. < 6 < 6*: 



>M LB , 



n,6) 



-nE r (<5) 



-nE r (<5) 



+ 



1 



For S < d rr : 



For 5 = 5 r 



rar(2 - e 2 ( s *- s )) y/^(e^ 5 '- s ) - 1) 
v ^F( e 2(«*-«) _ 1) i 1 + ° (A)) • 



(1 + 0(1)) (93) 
(94) 

(95) 



yMLB, 



n, 8 cr ) 



-nE r (Scr) _ 



1 + -!= 



(96) 



Notes: 



For 5 > 5 rr , P t 



MLB, 



n, 6) is indeed asymptotically worse than P e with the optimal 



r = r eS (1371) . see (|72l) . Specifically, the choice of r = y/nae s *~ s only balances the 
exponents of the two expressions of the bound (|37l) . while leaving the sub-exponential 
terms unbalanced - see (|93l . The optimal selection r = r e fr balances the sub-exponential 
terms to the order of n~2 e2{S s \ see Theorem [TOl This in fact quantifies the asymptotic 
gap between the bounds, as seen in the Fig. [21 

For 5 < S cr , the selection of the suboptimal r has no asymptotic effect, as seen by 
comparing (1931 ) and (|83l) . This corroborates the numerical findings presented in Fig. |3] 
For 5 = d cr the asymptotic form of the bound is changes by a constant (compare (1961 ) 
and (I89l),(l90l)), and the correction term in the approximation tighter. 
Proof: Appendix HI ■ 



VI. ASYMPTOTICS FOR FIXED ERROR PROBABILITY 

In the previous section we were interested in the asymptotic behavior of P e (n, S) when 
the NLD d is fixed. We now turn to look at a related scenario where the error probability e 
is fixed, and we are interested in the asymptotic behavior of the optimal achievable NLD, 
denoted 6 £ (n), with n — > oo. This setting parallels the channel dispersion type results 
[[71 [[61 [[2TI Problem 2.1.24], and is strongly related to the dispersion of the power constrained 
AWGN channel ED©. 



A. The Dispersion of Infinite Constellations 

Let e > denote a fixed error probability value. Clearly, for any e, d £ (n) approaches the 
optimal NLD S* as n — > oo. Here we study the asymptotic behavior of this convergence. 

Theorem 15: For a fixed error probability e, the optimal NLD d £ (n) is given, for large 
enough n, by 

S e (n) = 6*- \P-Q-\e) + ^\ogn + O (-) . (97) 



2n 2n \n 
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Fig. 9. Bounds and approximations of the optimal NLD S e [n) for error probability e = 0.01. Here the noise variance 
a 2 is set to 1. 



The proof is based on an asymptotic analysis of the finite-dimensional bounds derived 
in Section [IV] Specifically, the converse bound (an upper bound in (1971) ) is based on the 
sphere bound ©. The achievability part (a lower bound in (|97l) ) is based on the ML bound 
(1371) . The weaker typicality bound is also useful for deriving a result of the type (197b . but 
in a slightly weaker form - the typicality bound can only lead to 



(98) 



In Fig. [9] we show the bounds on 8 e (n) that are derived from the finite dimensional 
bounds on P e (n, 5) given in Sec. [TV] along with the asymptotic form (1971 ), derived in this 
section, which tightly approximates S £ (n). In addition, the term (1981) is also depicted, which 
only loosely approximates S £ (n). The chosen error probability for the figure is e = 0.01. 

Before proving the theorem, let us discuss the result. By the similarity of Equations © 
and (|97l ) we can isolate the constant | and identify it as the dispersion of the unconstrained 
AWGN setting. This fact can be intuitively explained from several directions. 

One interesting property of the channel dispersion theorem (OQ) is the following connection 
to the error exponent. Under some mild regularity assumptions, the error exponent can be 
approximated near the capacity by 

(C - R) 2 



E(R) 



2V 



(99) 
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where V is the channel dispersion. The fact that the error exponent can be approximated by 
a parabola with second derivative y was already known to Shannon (see [|6l Fig. 18]). This 
property holds for DMC's and for the power constrained AWGN channel and is conjectured 
to hold in more general cases. Note, however, that while the parabolic behavior of the 

exponent hints that the gap to the capacity should behave as O (^) > me dispersion theorem 
cannot be derived directly from the error exponent theory. Even if the error probability was 
given by e - nE ( R ) exactly, (Q]) cannot be deduced from (l99l (which holds only in the Taylor 
approximation sense). 

Analogously to <|99~1 ), we examine the error exponent for the unconstrained Gaussian 
setting. For NLD values above the critical NLD d cr (but below 6*), the error exponent is 
given by 0: 

e' 2S 1 

E{S) = + 6 + - log 2na 2 . (100) 

47rea z 2 

By straightforward differentiation we get that the second derivative (w.r.t. <5) of E(<5, a 2 ) 
at d = S* is given by 2, so according to (|99| ), it is expected that the dispersion for the 
unconstrained AWGN channel will be |. This agrees with our result (l97t and its similarity 
to (OQ), and extends the correctness of the conjecture (199} to the unconstrained AWGN setting 
as well. It should be noted, however, that our result provides more than just proving the 
conjecture: there also exist examples where the error exponent is well defined (with second 
derivative), but a connection of the type (l99l can only be achieved asymptotically with 
e — > (see, e.g. Il22l0 . Our result (1971 ) holds for any finite e, and also gives the exact - logn 
term in the expansion. 

Another indication that the dispersion for the unconstrained setting should be ~ comes 
from the connections to the power constrained AWGN. While the capacity |log(l + P), 
where P denotes the channel SNR, is clearly unbounded with P, the form of the error 
exponent curve does have a nontrivial limit as P — > <x>. In @ it was noticed that this limit 
is the error exponent of the unconstrained AWGN channel (sometimes termed the 'Poltyrev 
exponent'), where the distance to the capacity is replaced by the NLD distance to S*. By 
this analogy we examine the dispersion of the power constrained AWGN channel at high 
SNR. In [6] the dispersion was found, given (in nat 2 per channel use) by 

_ P(P + 2) 

Vawgn - 2 (p + !)2- (1U1) 

This term already appeared in Shannon's 1959 paper on the AWGN error exponent [|5), 
where its inverse is exactly the second derivative of the error exponent at the capacity (i.e. 
( l99l holds for the AWGN channel). It is therefore no surprise that by taking P — > oo, 
we get the desired value of |, thus completing the analogy between the power constrained 
AWGN and its unconstrained version. This convergence is quite fast, and is tight for SNR 
as low as lOdB (see Fig. [TOl) . 

B. A Key Lemma 

In order to prove Theorem [15] we need the following lemma regarding the norm of a 
Gaussian vector. 

Lemma 8: Let Z = [Z±, Z n ] T be a vector of n zero-mean, independent Gaussian 
random variables, each with mean a 2 . Let r > be a given arbitrary radius. Then the 
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SNR [dB] 

Fig. 10. The power-constrained AWGN dispersion (11011 (solid) vs. the unconstrained dispersion (dashed) 



following holds for any dimension n: 

Pr{||Z|| >r}-Q 

where 



2 2 

r — no 



< 



QT 



n 



T = E 



X 2 -l 



V2 



3.0785, 



(102) 



(103) 



for a Standard Gaussian RV X. 

Proof: The proof relies on the convergence of a sum of independent random variables 
to a Gaussian random variable, i.e. the central limit theorem. We first note that 



Pr{||Z||>r} = pJ J>f > 



(104) 



i=i 



Let Y t = 3l^L-. it is easy to verify that E[Y;] = and that VAR[Yi\ = 1. Let S n 
~jn Y^!i=x Yi- Note that S n also has zero mean and unit variance. It follows that 



T1 | x ^ Z't - o 2 r 2 - no 2 



i=i 

n 



o 2 V2 



o 2 y/2 



, , i \ - ir r 2 — no 2 



Pv<S n > 



2 2 

r — no 



o 2 V2n 



(105) 
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S n is a normalized sum of i.i.d. variables, and by the central limit theorem converges to a 
standard Gaussian random variables. The Berry-Esseen theorem (see Appendix U) quantifies 
the rate of convergence in the cumulative distribution function sense. In the specific case 
discussed in the lemma we get 



Pr {S n > 



na 



a' 



Q 



na 



a" 



2n 



< 



6T 



n 



(106) 



where T = E[|Fj| 3 ]. Note that T is independent of a 2 , finite, and can be evaluated numer- 
ically to about 3.0785. ■ 



C. Proof of Theorem [75] 
Proof of Direct part: 

Let e denote the required error probability. We shall prove the existence of an IC (more 
specifically, a lattice) with error probability at most e and NLD satisfying (|971) . 

It is instructive to first prove a slightly weaker version of (|971 ) based on the typicality 
decoder (Theorem [3). While easier to derive, this will show the existence of lattices with 



NLD 8 



L n-it 



Q 



O (-) . Proving the stronger result (1971 is more technical and 



will proven afterwards using the ML achievability bound (Theorem [5]). 

Recall the achievability bound in Theorem [3] for any r > there exist lattices with NLD 
S and error probability P e that is upper bounded by 



P e <^V n r n + Pr 



We determine r s.t. PrdlZll > r) 



i 



Z|| > r}. 

and 7 s.t. ^V n r n 
1 



assured that the error probability is not greater than the required e 

define a n s.t. r 2 = na 2 (l + a n ) (note that r implicitly depends on n as well) 
Lemma 9: a n , defined above, is given by 



(107) 

This way it is 
+ A= = e. Now 



a n = \-Q- 1 ( 
V n 



O 



1 - 



Proof: By construction, r is chosen s.t. 

Pr(||Z|| 2 > r 2 ) = 
By the definition of a n , 

Pr(||Z|| 2 >na 2 (l + a n )) =e 

By Lemma [8l 



(108) 



(109) 



(110) 



Pr(||Z|| 2 > na 2 {l + a n )) = Q 



Q 



na 2 (l + a n ) 



na 



a" 



2n 

0[ — 

>n 



O 



(111) 
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Combined with (II 101 ), we get 



1 - 



Q 



a n )+0 



or 



6 + 0[^\=Q[ J-a n . 



Taking Q of both sides, we get 



-a n = Q- L (e + O [-= 



By the Taylor approximation of Q 1 (e + x) around x = 0, we get 



a n = Q- L (e) + O 



or 



(112) 
(113) 

(114) 

(115) 
(116) 



as required. ■ 
So far, we have shown the existence of a lattice A with error probability at most e. The 
NLD is given by 

S = — log 7 

n 

1 i 

= - log 



n V n r n y/n 

1 i i logn 1 , 

- log V n - log r h - log e 

n In n 

1 1 log Tl 1 

- log V n - - log[ncr 2 (l + otn)] - — — + - logs, 
n 2 2n n 



V n can be approximated by (see Appendix 10) by 



1 



1 , 2vre 1 



- log V n = - log — log n + O [ - 



n 



n 2n 



n 



We therefore have 



S = -I log(27re(x 2 ) - J log(l + a n ) + O [ - 



n 



(a) ,* 1 



<T--log(l + a n ) + - 



(b) r * 1 



S*--a n + Oi- 



n 



(c) 



2n 



(117) 

(118) 
(119) 
(120) 

(121) 
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where (a) follows from the definition of 5*, (b) follows from the Taylor approximation for 
log(l + a n ) around a n = and from the fact that a n = 0(l/^/n), and (c) follows from 
Lemma [9j This completes the achievability part based on the typicality decoder. 



In order to prove the stronger achievability result that fits (1971) we follow the same steps 
with the ML achievability bound. By Theorem [5] we get that for any r > there exist a 
lattice with density 7 and error probability upper bounded by 



P e <lV n [ f R (f)r n dr + Pr{\\Z\\ > r} 
Jo 



(122) 



Now determine r s.t. Pr(||Z|| > r) 



and 7 s.t. ^V n jl f R (r)r n dr = ^. 



Again, it is assured that the error probability is upper bounded by e. Define a n s.t. r 2 
na 2 (l + a n ). 

The resulting density is given by 



7 



VnVn Jo fn(r)r n dr'' 



(123) 



and the NLD by 



S = — log 7 

n 



1 1 r r 

-logs log y/nV n / f R (r)r n dr 

n n [ Jo 



1 1 f 

log V n log / f R {r)r n dr 

n n J 



— log e log n 

n 2n 

--log log / f R (r)r n dr + O - 

2 n n In \n 



(124) 



where the last equality follows from the approximation (II 171) for V n . 

We repeat the derivation as in Eq. (|74l where r* is replaced by r = ^Jna 2 (l + a n ) and 
have 



^/ no- 2 (l+o n ) o-n/2 n /-l+a,! 

1 L2J "'O 



< a 



n 2~ n / 2 n n 2(1 + a n )"e" n(1+a ' l)/2 
TTS n(l-a n -J) 

2-"/2^n 2g«log(l+«„) e -n(l+a, l )/2 



r[f] 



(i-^-I) 



where the inequality follows from Lemma |6] Therefore the term in (11241) can be bounded 
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by 






— log 


i 




n 






1 

< - 
~ 2 


log 




1 

~ 2 


log 


■y- 


1 

~ 2 


log 


,v- 



f R {f)f n df 



|lo. 



g2 + logn + log(l + a n ) - \(l + a n ) + - log — — -^y 

n 2 1 L 2 J I 1 Q ™ n) 



\ log2 + logn + log(l + o„) - 1(1 + a n ) + - log — ^ + O (i) 

- I log 2 + log n + log(l +a B )-i(l + a n )-i(| log(Trn) + f log f ) f i ) 
= ^logcr 2 + ±logn + log(l + a n ) - \a n - ^logn + O (±) 
= ^loga 2 + ±logn + |a n - ^logn + O (J) 



(a) follows from the Taylor expansion of log(l + £) at £ = and from the fact that 
direct part. 



«n = 0(^=). Plugging back to (11241) combined with Lemma [9] completes the proof of the 



Proof of Converse Part: 

Let e > 0, and let {<S n } ngM be a series of IC's, where for each n, P e (S n ) < e. Our goal 
is to upper bound the NLD 5 n of <S n for growing n. 
By the sphere bound we have 

e >P e (S n ) >Pr{||Z|| >r*}, (125) 

where r* = e~ Sn Vn^ n . By Lemma [H 

s > Pr{||Z|| >r*}>Q( - * (126) 

where T is a constant. It follows by algebraic manipulations that 

S n < -~ log ^1 + ^g- 1 (e + \ - - log V n - ~ log(M 2 ). (127) 

By the Taylor approximation of log(l + x) at x = and of Q~ l (y) at y — e, and by the 
approximation (11171 ) for V^, 

By the definition of (5* we finally get 



5,, < - w ' — Q" J ( :) - ^ log — + J-logn - \ \og(no 2 ) +o(-). (128) 

1 n In 2 \n, 



S n <S*- ^Q- 1 (e) + ^logn + O (- ) , (129) 



2n V n 

as required 




Fig. 11. Low-dimensional IC's for coding over the unconstrained AWGN. The error probability is set to e = 0.01. 



VII. Comparison with Known Infinite Constellations 

In this section we compare the finite dimensional bounds of Section [IV] with the perfor- 
mance of some known IC's. 

We start with the low dimensional IC's, which include classic sphere packings: the 
integer lattice, the hexagonal lattice, the packings D A , E s , BWie an d the leech lattice 
A 2 4 (see Conway and Sloane Ifl2l0 . In low dimensions we present Monte Carlo simulation 
results based on the ML decoder. In higher dimensions we consider low density lattice 
codes (LDLC) flU with dimensions n = 100, 300, 500 and 1000 (designed by Y. Yona). In 
dimension n = 127 we present the results for the packing S127 11241 . 

In Fig. QT] we show the gap to (Poltyrev's) capacity of the low dimensional IC's, where 
the error probability is set to e = 0.01. As seen in the figure, these low dimensional IC's 
outperform the best achievability bound (Theorem [5]). At n = 1, the integer lattice achieves 
the sphere bound (and is, essentially, the only lattice for n = 1). 

From the presentation of Fig. [TT]it is difficult to compare IC's with different dimensions. 
For example, the hexagonal lattice closer to the capacity than the lattice -D 4 , and also the gap 
to the sphere bound is smaller. Obviously this does not mean that D A is inferior. To facilitate 
the comparison between different dimensions we propose the following comparison: Set a 
fixed value for the error probability for n — 1 denoted e%. Then define, for each n, the 
normalized error probability 
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Using this normalization enables the true comparison between IC's with different dimen- 
sions. The achieved gap to capacity with a normalized error probability remains the same 
when a scheme is used say k times, and the block length becomes k ■ n. For example, 
the integer lattice maintains a constant 8 for any n with the normalized error probability, 
as opposed to the case presented in Fig. [CD where the performance decreases. In Fig. [[2] 
we plot the same data as in Fig. [TT] for normalized error probability with S\ = 10~ 5 . 
We also plot the normalized error probability itself for reference. In Fig. [13] we present 
the performance of IC's in higher dimensions (again, with normalized error probability 
and e 1 = 1CT 5 ). The included constellations are the leech lattice again (for reference), 
LDLC with n = 100, 300, 500, 1000 and degrees 5, 6, 7, 7 respectively (cf. (23) and U251 for 
more details on the construction of LDLC and the degree). For LDLC's, the figure shows 
simulation results based on a suboptimal low complexity parametric iterative decoder [j25l . 
In addition, we present the performance of the packing S^ E^ (which is a multilevel coset 
codeEU). 
Notes: 

• At higher dimensions, the performance of the presented IC's no longer outperforms 
the achievability bound. 

• It is interesting to note that the Leech lattice replicated 4 times (resulting in an IC 
at n = 96) outperforms the LDLC with n = 100 (but remember that the LDLC 
performance is based on a low complexity suboptimal decoder where the Leech lattice 
performance is based on the ML decoder). 

• The approximation (1971 ) no longer holds formally for the case of normalized error prob- 
ability. This follows since the correction term in d9VT > depends on the error probability. 
Nevertheless, as appears in Fig. \\3\ the approximation appears to still hold. 



VIII. VOLUME-TO-NOISE RATIO ANALYSIS 

The VNR \i, defined in (|20l) , can describe the distance from optimality for a given IC 
and noise variance, and we say that an IC S operating at noise level a 2 is in fact operating 
at VNR //. Equivalently, we can define the VNR as a function of the IC and the error 
probability: For a given IC S and error probability e, let ix{S,e) be defined as follows: 

-2,5 (S) 

(130) 

where cr 2 (e) is the noise variance s.t. the error probability is exactly e. Note that fx(S,e) 
does not depend on scaling of the IC S, and therefore can be thought of as a quantity that 
depends only on the 'shape' of the IC. 

We now define a related fundamental quantity fJ, n (e), as the minimal value of fi(S,e) 
among all n-dimensional IC's. It is known that for any < e < 1, /J, n (e) — > 1 as n — > oo 
ifTTl . We now quantify this convergence, based on the analysis of S e (n). It follows from 
the definitions of fj, n (e) and S £ (n) that the following relation holds for any a 2 : 

-2<5 £ (n) 

(note that S e (n) implicitly depends on a 2 as well). We may therefore use the results in the 
paper to understand the behavior of fM n (e). For example, any of the bounds in Theorem [3j 
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Fig. 12. Top: performance of different constellations (dimensions 1 — 24) for normalized error probability, with ei = 10 
Bottom: the normalized error probability. 




Fig. 13. Performance of different constellations (dimensions 24 — 1000) for normalized error probability, with z\ = 10 



Theorem |5] or the sphere bound (Theorem |2) can be applied in order to bound fj, n (s) for finite 
n and e. Furthermore, the asymptotic behavior of n n (e) is characterized by the following: 
Theorem 16: For a fixed error probability < e < 1, The optimal VNR fj, n (e) is given 

by 



l + \f^Q- 1 {e)--\ogn + o(-\ 
V n n \n J 



(132) 



Proof: In Theorem \\5\ we have shown that for given e and a 2 , the optimal NLD S is 
given by 

log n + O ' 



S e (n) = 5*- 

where 5* = |log^. 

According to (11311) we write 

Hn(e) = exp 



77 



(133) 



^Q- 1 (e)--l0g77 + 0f^ 



2 g- 1 ( £ ) - -logn + O 
77 n 



where the last step follows from the Taylor expansion of e a 



(134) 
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IX. Summary 

In this paper we examined the unconstrained AWGN channel setting in the finite dimen- 
sion regime. We provided two new achievability bounds and extended the converse bound 
(sphere bound) to finite dimensional IC's. We then analyzed these bounds asymptotically in 
two settings. In the first setting where the NLD (which is equivalent to the rate in classic 
channel coding) was fixed, we evaluated the (bounds on the) error probability when the 
dimension n grows, and provided asymptotic expansions that are significantly tighter than 
those in the existing error exponent analysis. In the second setting, the error probability e is 
fixed, and we investigated the optimal achievable NLD for growing n. We showed that the 
optimal NLD can be tightly approximated by a closed-form expression, and the gap to the 
optimal NLD vanishes as the inverse of the square root of the dimension n. The result is 
analogous to the channel dispersion theorem in classical channel coding, and agrees with the 
interpretation of the unconstrained setting as the high-SNR limit of the power constrained 
AWGN channel. The approach and tools developed in this paper can be used to extend the 
results to more general noise models, and also to finite constellations. 
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Appendix A 
Proof of the Bounds Equivalence 



Proof of Theorem It remains to show that 



2r pr* 
n-1 



n l w n ~ Pr{Z G D(r, w)}dw = / f R (p)p n dp. (135) 
'o Jo 



Lemma 10: For Z ~ N(0,la 2 ), and any r > w/2 > 0, 



y r 2 — z 2 

Pr{Z e D(r,w)} = [ f z (z)f ° f Xn _,{t)dtdz, (136) 

Jw/2 JO 



where D(w, r) was defined after Eq. (|23l ). fz{z) = e z2 ^ 2<t2) ^ s tne pdf of a N(0, a 2 ) 
random variable, and f Xn _ t {t) = J-i '^ 1S tne pdf of a x random variable with n — 1 

degrees of freedom. 

Proof: By the spherical symmetry of the Gaussian pdf, we may assume w.l.o.g. that 
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the hyperplane at distance ^ is perpendicular to the Z x axis. We therefore have 

w 

Pr{Z G D(w,r)} = Pr{Z l > -, ||Z|| < r} 



= Pv\Z 1 >-,J2z?<r 



2 

i=i 



r-r ( n ~\ 

/ f z (z)PT\J2z!<r 2 \Z 1 =z\ 
■W 2 { i=i J 

J ™/ 2 { i=2 



Jw/2 JO 



y/r 2 — 



2 



lw/2 

where the last equality follows from the fact that a Xn-i random variable is equivalent to 
the square root of a sum of n — 1 independent squared standard Gaussian random variables. 



We use the result of the lemma and get 

i-2r 

n w n ~ 1 Pr{Z G D(r,w)}dw 
Jo 



2r 

n-1 



yj r 2_ z 2 



~-n / in"' 1 / f z (z) I f Xn _ x {t)dtdzdw 

JO Jw/2 



2r r-r — J 



=n / / ^"7^) / f Xn _ x {t)dtdzdw 

'0 Jw/2 Jo 



P r r 2z 

(a) 



f f'w^fziz) [ ° j Xn _ x (t)dtdwdz 
Jo Jo Jo 

(2zrf z (z)f Xn _ 1 (t)dtdz, 

'o Jo 

were (a) follows from changing the order of integration. We set u = z/a and get 

r-r/a pyj r 2 /<r 2 —u 2 

/ / (2au) n af z (au)f Xn _ 1 (t)dtdu 
Jo Jo 

r-r/a r-Jr 2 /(j 2 -u 2 i j-n-2 p -t 2 /2 

of+l n /t/ct rJr 2 /a 2 ~v? 

= ^ / / u n t n - 2 e-^ +t ^ 2 dtdu. 
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We switch to polar coordinates and set u = pcos8 and t = psin8. The expression becomes 
— -r— rv / / p 2n ~ l cos n 9 sm n - 2 9e- p 12 dOdp 

nf+l—n /t/ct /-7r/2 

= - 7 ^ / p 2n - x e- p l2 dp \ cos n 6sm n - 2 6d6. (137) 
It can be shown using e.g. J26l Eqs. 18.32 and 25.9] that 



cos n 9 sin™" 2 = , \ • (138) 



o 



r(f) 

Equation (|137l) now simplifies to 

2 1 ^e-^dp 



r(f) 

^ r a f xn (p)P n d P 

Jo 

~-v n f ° af R (ap)p n dp 
Jo 

fR(p')p' n dp 



fn(p)p n dp, 

where f Xn (-) is the pdf of a x random variable with n degrees of freedom, and /#(•) is the 
pdf of ||Z||. This completes the proof of the theorem. ■ 

Appendix B 
Properties of Regular IC's 

Proof of LemmaWi Let S be a regular IC with a given r . Let V(o) denote the union 
of all the Voronoi cells of code points in Cb(a): 

y(a)4 |J w( s ). (139) 

se5DCb(a) 

Since all Voronoi cells are bounded in spheres of radius r , we note the following (for 

a > 2r ): 

• All the Voronoi cells of the code points in Cb(a) are contained in Cb(a + 2tq), and 
therefore V(a) C Cb(a + 2r ). 

• Any point in Cb(a — 2r ) must be in a Voronoi cell of some code point. These code 
points cannot be outside Cb(a) because the Voronoi cells are bounded in spheres of 
radius r , so they must lie within Cb(a), and we get that Cb(a — 2r ) C V(a). 

It follows that 

(a-2r ) n <|V(r)|<(a + 2r )", 



or 



(a - 2r ) n < ^ v(s) < (a + 2r ) n . (140) 

se5nCb(a) 
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Dividing by a n and taking the limit of a — > oo gives 

lim Ese5nCb(a)i;(g) = 1. (141) 

a— >oo a n 

Since, by assumption, the limit of the density 7(5) exists, we get 

7(5) = lim MM 

a-¥oo a n 

M(S,a) 

= llm ^ TT 

1 

lim^oo E a [v(S)] 
1 



(142) 

v{S) 

As a corollary, we get that for regular IC's the average volume v(S) exists in the limit (and 
not only in the lim sup sense). ■ 

Appendix C 
Convexity of the equivalent sphere bound 

Proof of Lemma \3} 

Suppose v is the volume of the Voronoi cell. The radius of the equivalent sphere is given 
by r = v l l n Vn . The equivalent sphere bound is given by 



SPB(v) = Pr\Y,Zf> 



r 2 



i=l 



,2/n 



-Pr BW> 

U=l V n C 

= Pr|E(V^) 2 >(Ci-«) a/n |. (143) 

where C\ is a constant. 

We note that J2i=i(^i/ a ) 2 I s a sum °f n i-i-d- squared Gaussian RV's with zero mean and 
unit variance, which is exactly a x 2 distribution with n degrees of freedom. We therefore 
get: 

SPB(v) = — -A — ^ / x n / 2 - 1 e- x/2 dx 



r(n/2)2»/a y (Cl .„ )2 /n 



= C 2 / x^e^dx 

i(Ci-n) 2/n 

^CzFid-v), (144) 

where C 2 is a constant and = f^„ x"/ 2_1 e _:c / 2 Gfe. It can be verified by straightforward 
differentiation that 

Q2 Q2 roc 



[°° x^e-^dx = -A^ exp ( -^A , (145) 
J t 2/ n n 2 \ 2 J 

which is strictly positive for all t > 0. Therefore F(t) is convex, and the equivalent sphere 
bound SPB(t>) = C 2 F(Ci ■ v) is a convex function of t> . ■ 
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Appendix D 
Proof of the Regularization Lemma 

Proof of Lemma 0' Our first step will be to find a hypercube Cb(a*), so that the 
density of the points in S fl Cb(a*) and the error probability of codewords in S fl Cb(a*) 
are close enough to 7 and e, respectively. We then replicate this cube in order to get a 
regular IC with the desired properties. The idea is similar to that used in (31 Appendix C], 
where it was used for expurgation purposes. As discussed in HV-DI above, we wish to avoid 
expurgation process that weakens the bound for finite dimensional IC's. 
By the definition of P e (<S) and 7(5), 

M(S,a) M(S,b) ..... 
7(0 ) = hmsup = hm sup (146) 

a^oo a n a^co b>a b n 

£ = pJS) = limsup — — r V PJs) = lim sup — — - V PJs). (147) 
a-^x, M(S,a) ^ , s KJ a^oo b> l M(S, b) ^-f, v ; 
v ' ' se-sncb(a) 0>a v ' ; se-sncb(fe) 



Let r 7 = ^/l + £ and r E = 1 + |. 

By definition of the limit, there must exist ao large enough s.t. for every a > a , both 
hold: 

sup^l> 7 .i, (148) 



and 

Sm(5,1) 



^ P e ( S )<£-r e . (149) 



sesncb(b) 

Define A s.t. Q(A/a) — e ■ |, and define a a as the solution to 

a A + 2A 



(150) 



«A 

Let a max = max{a , a/J\. According to (11481 ), there must exist a* > a max s.t. 



7 .1. (151) 



By ([1491) we get that 

1 



uiq , E P ^ ^ SU P ITtW E ^(*)<e-r.. (152) 

Now consider the finite constellation G = S fl Cb(a*). For sgG, denote by -P e G (s) the 
error probability of s when G is used for transmission with Gaussian noise. Since G C S, 
clearly P<F(s) < P e (s) for all s £ G. The average error probability for G is bounded by 

P ^ G ) ~ W\ E P ^ s ) ^ 4 E P <^) < e • r e . (153) 

' ' sec ' ' sec 

We now turn to the second part - constructing an IC from the code G. 
Define the IC S' as an infinite replication of G with spacing of 2A between every two 
copies as follows: 

S' = {s + I- (a* + 2A) : s G G,I G Z n } , (154) 
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where Z n denotes the integer lattice of dimension n. 

Now consider the error probability of a point s E S' denoted by Pf(s). This error 
probability equals the probability of decoding by mistake to another codeword from the 
same copy of G or to a codeword in another copy. By the union bound, we get that 

Pf(s)<pC(s) + Q(A/a). (155) 

The right term follows from the fact that in order to make a mistake to a codeword in a 
different copy of G, the noise must have an amplitude of at least A. The average error 
probability over S' is bounded by 

Pe{S') < P e (G) + Q(A/a) <s-r £ + Q(A/a) = e(l + £) (156) 

as required, where the last equality follows from the definition of t £ and A. 

The density of points in the new IC enclosed within a cube of edge size a* + 2 A is given 
by \G\(a* + 2A)~ n . Define a k = (a* + 2A)(2/c — 1) for any integer k. Note that for any 
k > 0, Cb(dk) contains exactly (2k — l) n copies of G, and therefore 

M(S',a k ) = \G\(2k-ir = \G\ 
K ^ K ( a * + 2A) n ' 

For any a > 0, let k* be the minimal integer k s.t. a k > a. Clearly, 

Sfc*-i = Sfc* — (a* + 2A) < a < a k *. (158) 



Therefore 



and 



jgjrj < M(S',a) < M(S>,a k *) 



G| ojf..! M(^,a) < \G\ ~a n k * 



(a* + 2A) n a n a n ~ (a* + 2A) n a n 

By taking the limit a — > oo of (11601) . we get that the limit exists and is given by 

7(S0 = , im ^lA. = H (161) 

v ; a^oo a n (a* + 2A) n 



It follows that 

7(5') 



|G| 



(a, + 2A) n 

._ 1^1 < 
' a% (a, + 2A) n 

( Q ) 1 / a 
> 7 S)- ' 



a* + 2A 



(6) 1 

> 7(5)^- (162) 

where (a) follows from (|151l) and (6) follows from the definitions of r 7 , a a and from the 
fact that <2a < a*. 

It remains to show that the resulting IC S' is regular, i.e. that all the Voronoi cells can be 
bounded in a sphere with some fixed radius r . The fact that the average density is achieved 
in the limit (ant not only in the limsup sense) was already established in (1161b . 
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Let s be an arbitrary point in S'. By construction (see (11541 )), the points 

{s ± (a* + 2A)ej|i = 1, n} 

are also in S' (where e, denotes the vector of 1 in the 2-th coordinate, and the rest are 
zeros). We therefore conclude that the Voronoi cell W(s) is contained in the hypercube 
s + Cb(a* + 2A), and is clearly bounded within a sphere of radius r = y/n(a* + 2A). ■ 



Appendix E 
Proof of Integral Bounding Lemmas 

Proof of Lemma |3} Define 

F(p)4l g [pf- V^ 2 ] = Q - l) logp-^, 

so that pf~ 1 e~ np / 2 = exp[F (/>)]. Let -Fi(p) and F 2 (p) be the first and second order Taylor 
series of F(p) around p = x, respectively, i.e. 

Fi(p) = a + P(p-x); F 2 (p) = a + (5{p - x) - r 2 (p - xf (163) 

where 

x 2 



l ' 2x 2 



We note that for any £ > 0, 



It follows that for all p > x, 



e-^<io g (i+e)<e- (164) 



(166) 



F 2 (p) < F(p) < F^p), (165) 
and the integral is bounded from above and below by 

/*OG /*O0 /*OG 

/ e F ^dp< / p^e-^dp < / e Fl ^p. 
To prove the upper bound (|60T > we continue with 

/*oo /*oo 

/ e F ^rfp< / e F ^dp 

J X J X 

POO 

= e a exp [/3(p — x)] dp 



where the last equality follows from the assumption x > 1 — -. Plugging the values for a 
and /3 yields (l60l) . 
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To prove the lower bound (1601 ) we write 



e F2{p) dp 



poo 

/ exp [a + (5{p — x) — r 2 (p — x) 2 ] dp 

J X 

/ exp [a + 13 p — r 2 p 2 ] dp 
Jo 



(3 2 

6X P ( a + ^2 



exp 



P 

Tp -Yr 



dp 



exp a + -—r / exp 



At 2 / t 



-T p 



JL 

2r 2 



Plugging back the values for a, and r leads to (|6TI) . 

We continue with a well known lower bound for the Q function: 



dp 



Q{z)> 



1 



-Z 2 /2 



2nz 



1 



l + z- 



Vz > 0. 



Recalling the definition of T, we write 



(167) 



£ p^e-^dp > 2xte"^ exp [T 2 /2] ^J^^ ^ Q (T) 



n nx 



> 



2x 2 e 2 



n(x-l + ^) VI + T 



'-2 



to arrive at (l62l . Eq. (|63l ) follows immediately since 1 — £ < j^t for all (el. 



Proof of Lemma O - We rewrite the integrand as e G ( p ) where G(p) = —np/2 + (n — 
l)logp. Since G(p) is concave, it is upper bounded its first order Taylor approximation 
at any point. We choose the tangent at p = x. We denote by G\{p) the first order Taylor 
approximation at that point, and get 



where G'(p) 



9G( P ) 
dp 



G( P ) < G 1 (p) 4 G(x) + G\x)(p - x), 



-2 + 2=1. It follows that 

2 p 



(168) 



71 71 — 1 

G x {p) = (n - l)(logx -!)+(-_ + —— j ,>. 
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Since G(p) < Gi(p) for all p, we have 



-np/2 jn—1 



p n ~ L d P 



< 



Z G ^dL 



l Gl{p) d P 



2x r 



fX 


/ n n — 1 \ 


/ exp 


[b + x )"\ 


/o 





dp 



n 



>-i) 



(169) 



"(2-^-1) 
which gives (|75l) . 

Some extra effort is required in order to prove the lower bound (|76|) . We first switch 
variables and get 



-np/2 n— 1 



e 2ti u 



-n-l 



du 



(170) 



l/.r 

oo 



l/.r 

We lower bound the exponent as follows: 



/ exp ( (n + 1) log u ) du. (171) 

Ji/x v 2m J 



n 
2u 



(n + 1) logu 





n 




~2u 




n 




~2u 


(a) 


n 


> 






~2u 


(b) 


nx 


> 






2 




nx 




2 



+ (n + l)(logx — \og(ux)) 

+ (n + l)(logx — log(l + ux — 1)) 

+ (n + l)(logx — (ux — 1)) 



.2^2 



(a) follows from the fact that log(l + £) < £ for all £ G R. (b) follows from the fact that 
I < £ 2 - 3£ + 3 for all £ > 1 (which follows from the fact that (f - l) 3 > 0). 



So far the integral f*e np l 2 p n l dp is lower bounded by 



exp(a + (3(u — 1/x) — r 2 [u — l/x) 2 )du, 



(172) 



l/.r 



where 



a 







TlX 

(n + 1) logx - — ; 



nx 



[n + l)x: 



Following the same steps as in the proof of (1551 ) in Lemma [5] gives 



'l/x 



exp(a + /3(u — l/x) — r 2 (u — l/x) 2 ) > exp ( a + 



At 2 J r 



Q 



T 



V2j 



(173) 
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Plugging the values for a, (3 and r yields (|76l ). (1771 ) follows by applying the lower bound 
(11671) on the Q function. ■ 

Appendix F 
Approximating V n 

Here we derive the required approximations for V n , used in Sections [V] and [VTJ 
We first derive (|64l >. 

The volume of a hypersphere of unit radius V n is given by r^Jg+i) ( see ' e -§ - P- ^])- 
We use the Stirling approximation for the Gamma function for z G R (see, e.g. E71 Sec. 
5.11]). 

r(, + i,-*(,).,^0-(i + O (i)) 

=^(f) z ( i+o G))' (m) 

becomes 

K .^_.(-r i ( 1+0 (i)Y 

r(n/2 +1) \ n / vn7r \ \ n J J 

Eq. (11171) follows by taking i log(-) and the Taylor expansion of log(l + x) around x = 0: 

- log V n = - log tt - - log n - - log - + O 

-W^-i^ n+0 iS)- (176) 

Appendix G 
Evaluating the ML Bound at 8 cr 

Proof of Theorem \T2\- We start as in the proof of Theorem |5] to have 

e nScr V n [ f R (r)r n dr = ^e n5 V 2 a n (2Tt)-%n n f e~ np/2 p n ~ l dp. (177) 
Jo 2 J 

We evaluate the integral in two parts: 

[ P e~ np/2 p n ~ l dp = [ e~ np/2 p n - 1 dp+ [ P e- npt2 p n - l dp. (178) 
Jo Jo J2 

The term J 2 e~ np ' 2 p n ~ l dp can be evaluated by the Laplace method, as in the proof of 
Lemma |7J The difference is that the exponent is minimized with zero first derivative at the 
boundary point p = 2, which causes the integral to be evaluated to half the value of the 
integral in Lemma |7J i.e. 

[ e- npl% p n ~ X d P = (1 + 0(1)). (179) 
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The second term in (11781 ) requires some extra effort. We first upper bound it as follows: 



p rp i 

&- n p/ 2 n n ~ 1 rln — / _ e ~ n P/ 2 n n 



p n ~ 1 dp = / -e- nplz p n dp 
h P 

< / 2 e " P nd P 

J 2 

< / -e~ n 2 n dp 

J2 2 

= l e -«2>*-2), 

where (a) follows since in the integration interval, p > 2. (b) follows since e~ nP//2 p n is 
maximized at p = 2. With (|66l ) we have 

/ P e- np l 2 p n - x dp < -e~ n 2 n (p* - 2) 

J2 2 

= I e -»2» (j log(nTr) + O 

The integral can also be lower bounded as follows: 

/ e- np,2 p n - l dp > — / e- np/2 p n dp 
J 2 P* h 

> _ / e nlog--g(p-2) 2 rf 



^2 n e" n / e~8^ dp 

-2 n e"" / e~8" dp 
p* 



p* V n V 2 V 2 ^yfifc \ n 



—2 n e- n (p* - 2 + 

p* \ r \ ns/n 

2"e-«(l + 0(^)) 



(a) follows since p < p*. (6) follows from the fact that np/2 + n log p > n log | — |(p — 2) s 
for all p > 2 (which follows from (I164! )). (c) follows from the Taylor expansion Q(£) = 
§-^ + 0(£ 2 )andsincep*-2 = 0(^). 
In total we get 

^ e -np/2 p n-l dp = 2 n e -nl^0 (l + {^3 
J 2 ^ 
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Combined with (11791 ) we have 



e- npl2 p n - x dp 



2 pp* 
„-np/2 _n-lj_ , / -np/2 n-1 



'0 

2 n e~ n 



p n - L dp+ / e- np/z p n - l dp 



n log(ri7r) 
2n n 




(l + o(Jaf2 



The approximation (1641 ) for V n finally yields 



K / fn{r)r n dr = e 



-nE,.(<5 cr ) 



2tt 



7r log(n7r) 
2n n 




(l + o(*£s)), (180) 



and the proof is completed by adding the asymptotic form (|58l ) of the sphere bound at 
6 = S cr . ■ 



Appendix H 

Proof of Theorem \L3\- The typicality bound is given by 

P e (n,S) < 7 Kr n + Pr{||Z|| > r} 



(181) 



where r = a^Jn[l + 25* — 25). The rightmost term can be written as (see the proof of 
Theorem [9]): 

(n/2) n ' 2 



Pr{||Z|| > r} 



n i n 



r [f] ji+2(^*-5) 

The above integral can be bounded according to Lemma |5] by 

2x2 e 2 



< 



p2 1 e 2^(ip < 



n(x-l + J)l + T-2 ~ J x y y -n(x-l + l) 



(182) 



(183) 



where x = 1 + 2(6* — 5) and T 



approximation (1641 ) for V n 



6(- v /n). Eq. (l92l) then follows using the 



Appendix I 

Proof of Theorem O We first prove (1931 (and (|94l follows immediately). Let p 
e 2((5*-<5) -p^g jyjL bounds for r = y/nae s *~ s can be written as (see (l59l and (l74l): 

/-p o-n/2 n/2 /-do 

pMLB = n e n(ir+S) V 2 e n/2 2 nnn e -np/2 n-l rf + ™ / e -np/2 p n/2-l^ 

2 Jo "(n/2) 

Using Lemma |5] we get that 



-np/2 n/2-1 



p n/Z -'dp 



and using Lemma [6] we get that 



2pn/2 e -np/2 

n(p-l) 



xn/2 p -np/2 



p n ~ V d P 



2p n ' 1 e 







n(2-p) 



l + O I - 

n 



l + O ( - 

n 



(1931 then follows by simple algebra. 



(184) 



(185) 
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To show (1951 ), repeat the proof of Theorem QT|with p instead of p* . 

To show (1961 , repeat the proof of Theorem [12] with p instead of p*. Here p = 2, 
therefore there is no need to split the integral into two parts as in (I178I ). Therefore the 
term e n6 V n J Q r fii(f)r n df contributes the 4g part of the expression. The contribution of the 
sphere bound term (the term Pr{||Z|| > r}) is approximated as in (| 1 84b . Note that the result 
here is different than the r c g case, where the contributions of the two terms in the bound 
are of different order (see Eq. d89}). ■ 




By the central limit theorem (CLT), A normalized sum of n independent random variables 
converges (in distribution) to a Gaussian random variable. The Berry-Esseen theorem shows 
the speed of the convergence (see [128. , Ch. XVI. 5]). We write here the version for i.i.d. 
random variables, which is sufficient for this paper. 

Theorem 17 (Berry-Esseen for i.i.d. RV's l\28\I): Let {i^}" =1 be i.i.d. random variables 
with zero mean and unit variance. Let T = E[|Yj| 3 ] and assume it is finite. Let S n = 
Sr=i ^ be the normalized sum. Note that S n also has zero mean and unit variance. 

Then for all a E R and for all n E IN, 
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